2024-09-21T00:25:13.012 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:25:13.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:25:13.188 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913336' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLaoU27iFrNgEXp9ze40D0XjdCp3nIfnRqczYhwcBBRofg8w+uGvgknbmmtC8juxcZNHA2+0l3SthCMCexeMUpc= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCIeQP4cLdMUOV182cV3kmGcXwJIa2amDEZCESr4BzOhVN4Em3r4721Q1YgrXc/xGC7ZYvD59d3twAdp16oepRI= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP56RA7nfssoiSjIVwe6jauG9ncJi0LcMBrKKMLgNuDjc/MQ3V8w+AeV1ExawLqCM7ffHyo9iYGSFntLsHLISRg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:25:13.188 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:25:13.189 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:25:13.189 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:25:13.190 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:25:13.209 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:25:13.209 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:25:13.209 INFO:teuthology.packaging:ref: None 2024-09-21T00:25:13.209 INFO:teuthology.packaging:tag: None 2024-09-21T00:25:13.210 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:25:13.210 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:25:13.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:25:13.354 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:25:13.356 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:25:13.362 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:25:13.362 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:25:13.371 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:25:13.390 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:25:13.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:25:13.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:19:44.836848', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLaoU27iFrNgEXp9ze40D0XjdCp3nIfnRqczYhwcBBRofg8w+uGvgknbmmtC8juxcZNHA2+0l3SthCMCexeMUpc='} 2024-09-21T00:25:13.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:19:44.838546', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCIeQP4cLdMUOV182cV3kmGcXwJIa2amDEZCESr4BzOhVN4Em3r4721Q1YgrXc/xGC7ZYvD59d3twAdp16oepRI='} 2024-09-21T00:25:13.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:19:44.840262', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP56RA7nfssoiSjIVwe6jauG9ncJi0LcMBrKKMLgNuDjc/MQ3V8w+AeV1ExawLqCM7ffHyo9iYGSFntLsHLISRg='} 2024-09-21T00:25:13.468 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:25:13.475 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T00:25:13.475 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T00:25:13.475 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T00:25:13.475 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:25:13.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6620b40160>, signals=[15]) 2024-09-21T00:25:13.564 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:25:13.571 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:25:13.571 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:25:13.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:25:13.651 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-21T00:25:13.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:25:13.723 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T00:25:13.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:25:13.799 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:25:13.806 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-09-21T00:25:13.824 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-09-21T00:25:13.824 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:25:13.882 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:25:13.883 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:25:13.883 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:25:13.883 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-09-21T00:25:13.914 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-21T00:25:13.933 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-21T00:25:13.933 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:25:13.992 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:25:13.993 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:25:13.993 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:25:13.993 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:25:13.993 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-21T00:25:14.022 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-21T00:25:14.041 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-21T00:25:14.041 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:25:14.100 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:25:14.101 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:25:14.101 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-21T00:25:14.139 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:25:14.149 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:25:14.163 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:25:14.163 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:25:14.165 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:25:14.168 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:25:14.185 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:25:14.191 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:25:14.191 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:25:14.223 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:25:14.227 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:25:14.325 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:25:14.408 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:25:14.422 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:25:14.422 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T00:25:14.422 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T00:25:14.423 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:25:14.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:25:14.440 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-21T00:25:14.498 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:25:14.498 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-503.el9.x86_64 2024-09-21T00:25:14.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-09-21T00:25:18.248 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-21T00:25:20.199 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T00:25:26.217 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-21T00:25:27.676 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 19 kB 00:00 2024-09-21T00:25:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T00:25:34.119 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T00:25:36.084 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:25:36.084 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:25:36.183 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:25:36.192 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:25:36.193 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 79 M 2024-09-21T00:25:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 126 M 2024-09-21T00:25:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-09-21T00:25:36.763 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 124 kB/s | 36 kB 00:00 2024-09-21T00:25:41.029 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-09-21T00:25:41.862 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.6 MB/s | 29 MB 00:05 2024-09-21T00:25:42.787 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.5 MB/s | 35 MB 00:06 2024-09-21T00:25:42.788 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:25:42.788 INFO:teuthology.orchestra.run.smithi016.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-21T00:25:43.495 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-09-21T00:25:43.885 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-09-21T00:25:43.885 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-09-21T00:25:44.847 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-09-21T00:25:44.847 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-09-21T00:25:47.398 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-09-21T00:25:48.058 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:25:48.138 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:25:50.895 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:25:51.017 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:25:56.139 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:25:56.185 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:40.750 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:41.107 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:41.107 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:26:41.107 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:26:41.107 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:26:41.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:26:41.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:26:41.968 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:26:41.969 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-09-21T00:26:42.320 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:26:42.411 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:26:42.411 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:26:42.411 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:26:42.411 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:26:42.411 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:26:42.411 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T00:26:42.412 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:26:42.412 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:26:42.470 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:26:42.470 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:26:42.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 82.el9 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:26:42.504 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8274670 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:26:42.505 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:26:42.506 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-09-21T00:26:42.506 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:26:42.506 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:26:42.506 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:26:42.507 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:26:42.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:26:43.146 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-09-21T00:26:44.482 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:26:44.523 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-09-21T00:26:44.525 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-09-21T00:26:44.540 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.spd3mpiJk6 2024-09-21T00:26:44.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.spd3mpiJk6 2024-09-21T00:26:44.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.spd3mpiJk6 2024-09-21T00:26:44.746 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.spd3mpiJk6 is 6KB 2024-09-21T00:26:44.793 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.spd3mpiJk6 2024-09-21T00:26:44.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:26:44.870 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:26:44.870 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:26:44.870 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:26:44.870 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:26:44.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:26:45.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-09-21T00:27:15.014 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:27:15.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:27:15.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:27:33.487 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-09-21T00:27:42.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:27:42.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:28:42.490 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T00:28:54.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:28:54.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:28:54.882 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-21T00:28:55.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:28:55.254 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:28:55.254 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-21T00:28:55.271 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:28:55.272 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:28:55.272 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:28:55.272 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:28:56.272 DEBUG:teuthology.parallel:result is None 2024-09-21T00:28:56.273 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:28:56.279 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:28:56.279 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:28:56.282 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:28:56.284 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:28:56.303 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:28:56.332 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:28:56.340 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:28:56.341 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:28:56.344 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:28:56.347 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:28:56.468 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:28:56.475 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:28:56.475 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:28:56.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:28:56.492 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:28:56.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:28:56.509 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:28:56.511 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:28:56.535 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:28:56.581 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.595 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.608 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.621 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.624 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:28:56.626 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:28:56.632 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:28:56.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:28:56.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:28:56.637 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:28:56.664 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:28:56.673 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:28:56.673 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:28:56.703 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:28:56.705 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:28:56.722 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:56.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:56.847 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:56.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:56.974 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:28:56.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:28:57.041 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:57.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:57.139 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:57.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:57.266 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:28:57.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:28:57.333 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:57.380 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:28:57.434 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:57.520 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:28:57.562 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:28:57.562 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:28:57.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-09-21T00:28:57.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-21T00:28:57.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-21T00:28:57.670 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:28:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:28:57.706 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:28:58.196 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:28:58.204 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:28:58.204 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:28:58.215 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:28:58.225 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:28:58.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-09-21T00:28:58.314 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-09-21T00:28:58.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-09-21T00:28:58.381 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-09-21T00:28:58.383 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-09-21T00:28:58.451 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-09-21T00:28:58.453 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:28:58.454 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-09-21T00:28:58.484 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-09-21T00:28:58.485 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-09-21T00:28:58.509 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-09-21T00:28:58.510 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-09-21T00:28:58.531 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-09-21T00:28:58.531 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:28:58.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:28:58.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:28:58.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:28:58.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:28:58.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:28:58.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:28:58.621 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:28:58.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:28:58.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:28:58.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:28:58.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:28:58.729 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:28:58.732 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:28:58.840 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:28:58.849 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:28:58.850 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi123.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T00:32:56.530 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-09-21T00:32:56.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:32:56.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:32:56.629 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-21T00:32:56.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-21T00:32:56.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-21T00:32:56.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:32:56.774 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-21T00:32:56.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-21T00:32:56.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T00:32:56.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:32:56.933 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-21T00:32:57.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-21T00:32:57.014 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T00:32:57.024 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T00:32:57.024 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:32:57.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:32:57.026 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:32:57.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:32:57.029 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:32:57.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:32:57.055 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:32:57.056 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:32:57.070 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:32:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:32:57.082 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:32:57.095 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-09-21T00:32:57.096 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-09-21T00:32:57.096 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:32:57.106 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-09-21T00:32:57.107 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-09-21T00:32:57.120 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:32:57.120 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-09-21T00:32:57.122 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:32:57.131 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-09-21T00:32:57.134 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:32:57.137 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:32:57.146 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:32:57.160 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:32:57.198 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:32:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:32:57.201 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:32:57.202 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-21T00:32:57.202 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.202 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.202 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.202 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.203 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:32:57.204 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-21T00:32:57.204 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.204 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.204 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.204 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.217 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:32:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:32:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-21T00:32:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.222 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:32:57.222 INFO:teuthology.run_tasks:Running task install... 2024-09-21T00:32:57.230 DEBUG:teuthology.task.install:project ceph 2024-09-21T00:32:57.230 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T00:32:57.230 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:32:57.230 INFO:teuthology.task.install:Using flavor: default 2024-09-21T00:32:57.235 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T00:32:57.235 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T00:32:57.236 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:32:57.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:32:57.238 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:32:57.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:32:57.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:32:57.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:32:57.383 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:32:57.383 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:32:57.393 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:32:57.393 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:32:57.396 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:32:57.396 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:32:57.492 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:32:57.492 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:32:57.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:32:57.501 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:32:57.501 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:32:57.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:32:57.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:32:57.508 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:32:57.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:32:57.520 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:32:57.520 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:32:57.527 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:32:57.527 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:32:57.534 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:32:57.534 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:32:57.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:32:57.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:32:57.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:32:57.663 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:32:57.667 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:32:57.675 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:32:57.727 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-09-21T00:32:57.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-09-21T00:32:57.732 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-09-21T00:32:57.733 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-09-21T00:32:57.739 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-09-21T00:32:57.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-09-21T00:32:57.956 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-09-21T00:32:57.965 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-09-21T00:32:57.966 INFO:teuthology.orchestra.run.smithi016.stdout:45 files removed 2024-09-21T00:32:57.984 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:32:57.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:32:57.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:32:58.522 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-21T00:32:58.534 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-21T00:32:58.563 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-21T00:32:58.806 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T00:32:58.810 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T00:32:58.864 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T00:32:59.081 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T00:32:59.086 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T00:32:59.164 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 7.3 kB/s | 1.9 kB 00:00 2024-09-21T00:32:59.607 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-21T00:32:59.664 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T00:32:59.911 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-21T00:33:02.841 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-21T00:33:02.952 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-21T00:33:03.595 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 20 MB 00:02 2024-09-21T00:33:07.609 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-21T00:33:07.938 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T00:33:08.219 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-21T00:33:09.009 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-21T00:33:09.422 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-21T00:33:09.813 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T00:33:09.922 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T00:33:10.325 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T00:33:11.025 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T00:33:15.194 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T00:33:15.815 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T00:33:16.689 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T00:33:17.328 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.329 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.340 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:33:17.341 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.342 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:33:17.343 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:33:17.344 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:33:17.346 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:33:17.347 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:33:17.408 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-21T00:33:17.435 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:33:17.436 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:33:17.437 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:33:17.438 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-09-21T00:33:17.439 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:33:17.440 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:33:17.441 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:33:17.442 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:33:17.443 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:33:17.444 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:33:17.445 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:33:17.446 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:33:17.447 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:33:17.448 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:33:17.449 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:33:17.450 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:33:17.451 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout:Install 149 Packages 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 8 Packages 2024-09-21T00:33:17.452 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:33:17.453 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 228 M 2024-09-21T00:33:17.453 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-21T00:33:17.943 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.944 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.958 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:33:17.959 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:33:17.960 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:33:17.961 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:33:17.963 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:33:17.966 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:33:17.967 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:33:18.030 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-21T00:33:18.049 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T00:33:18.049 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:33:18.050 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:33:18.051 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:33:18.052 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:33:18.053 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:33:18.054 INFO:teuthology.orchestra.run.smithi123.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:33:18.055 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:18.056 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:33:18.057 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:33:18.058 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:33:18.059 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:33:18.060 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout:Install 149 Packages 2024-09-21T00:33:18.061 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 8 Packages 2024-09-21T00:33:18.062 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:33:18.062 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 228 M 2024-09-21T00:33:18.062 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-21T00:33:18.170 INFO:teuthology.orchestra.run.smithi178.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T00:33:18.395 INFO:teuthology.orchestra.run.smithi178.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 873 kB 00:00 2024-09-21T00:33:18.479 INFO:teuthology.orchestra.run.smithi178.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T00:33:18.554 INFO:teuthology.orchestra.run.smithi178.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T00:33:18.608 INFO:teuthology.orchestra.run.smithi123.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-09-21T00:33:18.696 INFO:teuthology.orchestra.run.smithi178.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T00:33:18.755 INFO:teuthology.orchestra.run.smithi178.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 2.3 MB 00:00 2024-09-21T00:33:18.991 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:18.992 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:33:19.004 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:33:19.004 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:33:19.005 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:33:19.006 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:33:19.008 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:33:19.010 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:33:19.011 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:33:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:33:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:33:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:33:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:33:19.097 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:33:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:33:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:33:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:33:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:33:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:33:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:33:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:33:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:Install 149 Packages 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 8 Packages 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:33:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 228 M 2024-09-21T00:33:19.107 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-09-21T00:33:19.125 INFO:teuthology.orchestra.run.smithi123.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 873 kB 00:00 2024-09-21T00:33:19.147 INFO:teuthology.orchestra.run.smithi178.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T00:33:19.216 INFO:teuthology.orchestra.run.smithi123.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T00:33:19.222 INFO:teuthology.orchestra.run.smithi178.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.5 MB/s | 5.0 MB 00:00 2024-09-21T00:33:19.264 INFO:teuthology.orchestra.run.smithi178.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 606 kB/s | 25 kB 00:00 2024-09-21T00:33:19.906 INFO:teuthology.orchestra.run.smithi178.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 14 MB/s | 10 MB 00:00 2024-09-21T00:33:19.973 INFO:teuthology.orchestra.run.smithi178.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T00:33:20.048 INFO:teuthology.orchestra.run.smithi178.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 361 kB/s | 27 kB 00:00 2024-09-21T00:33:20.049 INFO:teuthology.orchestra.run.smithi016.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-09-21T00:33:20.300 INFO:teuthology.orchestra.run.smithi016.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.4 MB/s | 873 kB 00:00 2024-09-21T00:33:20.325 INFO:teuthology.orchestra.run.smithi123.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 2.1 MB/s | 2.3 MB 00:01 2024-09-21T00:33:20.337 INFO:teuthology.orchestra.run.smithi178.stdout:(13/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 11 MB/s | 18 MB 00:01 2024-09-21T00:33:20.350 INFO:teuthology.orchestra.run.smithi016.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T00:33:20.357 INFO:teuthology.orchestra.run.smithi178.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 103 kB/s | 32 kB 00:00 2024-09-21T00:33:20.407 INFO:teuthology.orchestra.run.smithi178.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T00:33:20.449 INFO:teuthology.orchestra.run.smithi178.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.7 MB/s | 766 kB 00:00 2024-09-21T00:33:20.474 INFO:teuthology.orchestra.run.smithi178.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T00:33:20.533 INFO:teuthology.orchestra.run.smithi178.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.9 MB/s | 507 kB 00:00 2024-09-21T00:33:20.617 INFO:teuthology.orchestra.run.smithi178.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 541 kB/s | 45 kB 00:00 2024-09-21T00:33:20.691 INFO:teuthology.orchestra.run.smithi016.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 6.8 MB/s | 5.5 MB 00:00 2024-09-21T00:33:20.692 INFO:teuthology.orchestra.run.smithi178.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T00:33:20.784 INFO:teuthology.orchestra.run.smithi178.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.7 MB/s | 161 kB 00:00 2024-09-21T00:33:20.867 INFO:teuthology.orchestra.run.smithi016.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.4 MB/s | 2.3 MB 00:00 2024-09-21T00:33:20.876 INFO:teuthology.orchestra.run.smithi178.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T00:33:20.917 INFO:teuthology.orchestra.run.smithi016.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-09-21T00:33:20.951 INFO:teuthology.orchestra.run.smithi178.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.3 MB 00:00 2024-09-21T00:33:20.976 INFO:teuthology.orchestra.run.smithi178.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T00:33:21.010 INFO:teuthology.orchestra.run.smithi178.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T00:33:21.035 INFO:teuthology.orchestra.run.smithi178.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T00:33:21.067 INFO:teuthology.orchestra.run.smithi123.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-09-21T00:33:21.343 INFO:teuthology.orchestra.run.smithi016.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T00:33:21.367 INFO:teuthology.orchestra.run.smithi123.stdout:(6/157): ceph-base-19.3.0-5120.g18432218.el9.x8 1.9 MB/s | 5.5 MB 00:02 2024-09-21T00:33:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T00:33:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 434 kB/s | 170 kB 00:00 2024-09-21T00:33:21.503 INFO:teuthology.orchestra.run.smithi178.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.3 MB/s | 3.1 MB 00:00 2024-09-21T00:33:21.528 INFO:teuthology.orchestra.run.smithi178.stdout:(30/157): ceph-grafana-dashboards-19.3.0-5120.g 274 kB/s | 34 kB 00:00 2024-09-21T00:33:21.553 INFO:teuthology.orchestra.run.smithi178.stdout:(31/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.2 MB/s | 154 kB 00:00 2024-09-21T00:33:21.654 INFO:teuthology.orchestra.run.smithi178.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T00:33:21.754 INFO:teuthology.orchestra.run.smithi178.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 494 kB/s | 49 kB 00:00 2024-09-21T00:33:21.846 INFO:teuthology.orchestra.run.smithi178.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 178 kB/s | 16 kB 00:00 2024-09-21T00:33:21.922 INFO:teuthology.orchestra.run.smithi178.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T00:33:21.986 INFO:teuthology.orchestra.run.smithi016.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 17 MB/s | 18 MB 00:01 2024-09-21T00:33:22.055 INFO:teuthology.orchestra.run.smithi178.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.8 MB/s | 784 kB 00:00 2024-09-21T00:33:22.076 INFO:teuthology.orchestra.run.smithi016.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 275 kB/s | 25 kB 00:00 2024-09-21T00:33:22.139 INFO:teuthology.orchestra.run.smithi178.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 220 kB/s | 18 kB 00:00 2024-09-21T00:33:22.231 INFO:teuthology.orchestra.run.smithi178.stdout:(38/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T00:33:22.251 INFO:teuthology.orchestra.run.smithi016.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T00:33:22.323 INFO:teuthology.orchestra.run.smithi178.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-21T00:33:22.327 INFO:teuthology.orchestra.run.smithi016.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.9 MB/s | 226 kB 00:00 2024-09-21T00:33:22.398 INFO:teuthology.orchestra.run.smithi178.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-21T00:33:22.402 INFO:teuthology.orchestra.run.smithi016.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 360 kB/s | 27 kB 00:00 2024-09-21T00:33:22.424 INFO:teuthology.orchestra.run.smithi178.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T00:33:22.465 INFO:teuthology.orchestra.run.smithi178.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-21T00:33:22.477 INFO:teuthology.orchestra.run.smithi016.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 424 kB/s | 32 kB 00:00 2024-09-21T00:33:22.507 INFO:teuthology.orchestra.run.smithi178.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-21T00:33:22.533 INFO:teuthology.orchestra.run.smithi178.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T00:33:22.558 INFO:teuthology.orchestra.run.smithi178.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T00:33:22.570 INFO:teuthology.orchestra.run.smithi016.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T00:33:22.583 INFO:teuthology.orchestra.run.smithi178.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:33:22.609 INFO:teuthology.orchestra.run.smithi178.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T00:33:22.645 INFO:teuthology.orchestra.run.smithi016.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T00:33:22.711 INFO:teuthology.orchestra.run.smithi016.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T00:33:22.767 INFO:teuthology.orchestra.run.smithi178.stdout:(48/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T00:33:22.787 INFO:teuthology.orchestra.run.smithi016.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T00:33:23.009 INFO:teuthology.orchestra.run.smithi178.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 443 kB/s | 107 kB 00:00 2024-09-21T00:33:23.021 INFO:teuthology.orchestra.run.smithi016.stdout:(18/157): ceph-common-19.3.0-5120.g18432218.el9 6.3 MB/s | 20 MB 00:03 2024-09-21T00:33:23.062 INFO:teuthology.orchestra.run.smithi016.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T00:33:23.076 INFO:teuthology.orchestra.run.smithi178.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 943 kB 00:00 2024-09-21T00:33:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 2.4 MB/s | 5.0 MB 00:02 2024-09-21T00:33:23.109 INFO:teuthology.orchestra.run.smithi178.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-09-21T00:33:23.135 INFO:teuthology.orchestra.run.smithi178.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 173 kB/s | 22 kB 00:00 2024-09-21T00:33:23.154 INFO:teuthology.orchestra.run.smithi016.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T00:33:23.177 INFO:teuthology.orchestra.run.smithi178.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-09-21T00:33:23.179 INFO:teuthology.orchestra.run.smithi016.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T00:33:23.202 INFO:teuthology.orchestra.run.smithi178.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T00:33:23.213 INFO:teuthology.orchestra.run.smithi016.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T00:33:23.239 INFO:teuthology.orchestra.run.smithi016.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.3 MB/s | 321 kB 00:00 2024-09-21T00:33:23.277 INFO:teuthology.orchestra.run.smithi178.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-21T00:33:23.281 INFO:teuthology.orchestra.run.smithi016.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T00:33:23.303 INFO:teuthology.orchestra.run.smithi178.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-21T00:33:23.323 INFO:teuthology.orchestra.run.smithi016.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T00:33:23.348 INFO:teuthology.orchestra.run.smithi016.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.3 MB/s | 86 kB 00:00 2024-09-21T00:33:23.386 INFO:teuthology.orchestra.run.smithi178.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T00:33:23.421 INFO:teuthology.orchestra.run.smithi178.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T00:33:23.432 INFO:teuthology.orchestra.run.smithi016.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-21T00:33:23.471 INFO:teuthology.orchestra.run.smithi178.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.9 MB/s | 3.0 MB 00:00 2024-09-21T00:33:23.521 INFO:teuthology.orchestra.run.smithi178.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-09-21T00:33:23.524 INFO:teuthology.orchestra.run.smithi016.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T00:33:23.549 INFO:teuthology.orchestra.run.smithi016.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 292 kB/s | 34 kB 00:00 2024-09-21T00:33:23.554 INFO:teuthology.orchestra.run.smithi178.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-21T00:33:23.574 INFO:teuthology.orchestra.run.smithi016.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T00:33:23.588 INFO:teuthology.orchestra.run.smithi178.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-21T00:33:23.621 INFO:teuthology.orchestra.run.smithi178.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-21T00:33:23.655 INFO:teuthology.orchestra.run.smithi178.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T00:33:23.688 INFO:teuthology.orchestra.run.smithi178.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-21T00:33:23.731 INFO:teuthology.orchestra.run.smithi178.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 508 kB/s | 38 kB 00:00 2024-09-21T00:33:23.931 INFO:teuthology.orchestra.run.smithi178.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-21T00:33:23.956 INFO:teuthology.orchestra.run.smithi178.stdout:(68/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-09-21T00:33:24.031 INFO:teuthology.orchestra.run.smithi178.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:33:24.074 INFO:teuthology.orchestra.run.smithi178.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-21T00:33:24.099 INFO:teuthology.orchestra.run.smithi178.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T00:33:24.266 INFO:teuthology.orchestra.run.smithi178.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-21T00:33:24.349 INFO:teuthology.orchestra.run.smithi178.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T00:33:24.417 INFO:teuthology.orchestra.run.smithi016.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T00:33:24.458 INFO:teuthology.orchestra.run.smithi178.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-21T00:33:24.509 INFO:teuthology.orchestra.run.smithi016.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 7.9 MB/s | 7.4 MB 00:00 2024-09-21T00:33:24.542 INFO:teuthology.orchestra.run.smithi016.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.3 MB/s | 292 kB 00:00 2024-09-21T00:33:24.550 INFO:teuthology.orchestra.run.smithi178.stdout:(75/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-09-21T00:33:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 846 kB/s | 49 kB 00:00 2024-09-21T00:33:24.593 INFO:teuthology.orchestra.run.smithi016.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T00:33:24.618 INFO:teuthology.orchestra.run.smithi016.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T00:33:24.642 INFO:teuthology.orchestra.run.smithi178.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-21T00:33:24.660 INFO:teuthology.orchestra.run.smithi016.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 442 kB/s | 18 kB 00:00 2024-09-21T00:33:24.685 INFO:teuthology.orchestra.run.smithi016.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-21T00:33:24.692 INFO:teuthology.orchestra.run.smithi178.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T00:33:24.717 INFO:teuthology.orchestra.run.smithi178.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-21T00:33:24.767 INFO:teuthology.orchestra.run.smithi178.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T00:33:24.793 INFO:teuthology.orchestra.run.smithi178.stdout:(80/157): python3-colorama-0.4.6-3.el9.noarch.r 183 kB/s | 61 kB 00:00 2024-09-21T00:33:24.818 INFO:teuthology.orchestra.run.smithi178.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 190 kB/s | 19 kB 00:00 2024-09-21T00:33:24.836 INFO:teuthology.orchestra.run.smithi016.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T00:33:24.843 INFO:teuthology.orchestra.run.smithi178.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T00:33:24.869 INFO:teuthology.orchestra.run.smithi178.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-21T00:33:24.902 INFO:teuthology.orchestra.run.smithi016.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-21T00:33:24.952 INFO:teuthology.orchestra.run.smithi178.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-21T00:33:24.961 INFO:teuthology.orchestra.run.smithi016.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T00:33:24.978 INFO:teuthology.orchestra.run.smithi178.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-21T00:33:25.003 INFO:teuthology.orchestra.run.smithi016.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-21T00:33:25.011 INFO:teuthology.orchestra.run.smithi178.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T00:33:25.028 INFO:teuthology.orchestra.run.smithi016.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-21T00:33:25.036 INFO:teuthology.orchestra.run.smithi178.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-09-21T00:33:25.062 INFO:teuthology.orchestra.run.smithi016.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T00:33:25.078 INFO:teuthology.orchestra.run.smithi178.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-21T00:33:25.087 INFO:teuthology.orchestra.run.smithi016.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T00:33:25.103 INFO:teuthology.orchestra.run.smithi178.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T00:33:25.121 INFO:teuthology.orchestra.run.smithi016.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T00:33:25.146 INFO:teuthology.orchestra.run.smithi016.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T00:33:25.170 INFO:teuthology.orchestra.run.smithi178.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-21T00:33:25.196 INFO:teuthology.orchestra.run.smithi178.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-21T00:33:25.217 INFO:teuthology.orchestra.run.smithi123.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 2.9 MB/s | 20 MB 00:06 2024-09-21T00:33:25.221 INFO:teuthology.orchestra.run.smithi178.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-21T00:33:25.246 INFO:teuthology.orchestra.run.smithi178.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-21T00:33:25.247 INFO:teuthology.orchestra.run.smithi016.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-21T00:33:25.259 INFO:teuthology.orchestra.run.smithi123.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T00:33:25.297 INFO:teuthology.orchestra.run.smithi178.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-21T00:33:25.322 INFO:teuthology.orchestra.run.smithi178.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 584 kB/s | 44 kB 00:00 2024-09-21T00:33:25.338 INFO:teuthology.orchestra.run.smithi016.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-21T00:33:25.364 INFO:teuthology.orchestra.run.smithi178.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T00:33:25.381 INFO:teuthology.orchestra.run.smithi016.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-21T00:33:25.389 INFO:teuthology.orchestra.run.smithi178.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-09-21T00:33:25.415 INFO:teuthology.orchestra.run.smithi016.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 638 kB/s | 107 kB 00:00 2024-09-21T00:33:25.431 INFO:teuthology.orchestra.run.smithi178.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-21T00:33:25.448 INFO:teuthology.orchestra.run.smithi016.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T00:33:25.465 INFO:teuthology.orchestra.run.smithi178.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-21T00:33:25.473 INFO:teuthology.orchestra.run.smithi016.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T00:33:25.499 INFO:teuthology.orchestra.run.smithi178.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-21T00:33:25.499 INFO:teuthology.orchestra.run.smithi016.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T00:33:25.518 INFO:teuthology.orchestra.run.smithi123.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 4.3 MB/s | 10 MB 00:02 2024-09-21T00:33:25.524 INFO:teuthology.orchestra.run.smithi016.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T00:33:25.541 INFO:teuthology.orchestra.run.smithi178.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-21T00:33:25.549 INFO:teuthology.orchestra.run.smithi016.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T00:33:25.566 INFO:teuthology.orchestra.run.smithi178.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 949 kB/s | 64 kB 00:00 2024-09-21T00:33:25.574 INFO:teuthology.orchestra.run.smithi016.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T00:33:25.608 INFO:teuthology.orchestra.run.smithi178.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-21T00:33:25.633 INFO:teuthology.orchestra.run.smithi178.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 332 kB/s | 22 kB 00:00 2024-09-21T00:33:25.641 INFO:teuthology.orchestra.run.smithi016.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-21T00:33:25.667 INFO:teuthology.orchestra.run.smithi016.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-21T00:33:25.683 INFO:teuthology.orchestra.run.smithi178.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T00:33:25.692 INFO:teuthology.orchestra.run.smithi016.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T00:33:25.718 INFO:teuthology.orchestra.run.smithi123.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 18 MB 00:04 2024-09-21T00:33:25.725 INFO:teuthology.orchestra.run.smithi178.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-21T00:33:25.726 INFO:teuthology.orchestra.run.smithi016.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T00:33:25.743 INFO:teuthology.orchestra.run.smithi123.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.0 MB/s | 226 kB 00:00 2024-09-21T00:33:25.751 INFO:teuthology.orchestra.run.smithi178.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T00:33:25.751 INFO:teuthology.orchestra.run.smithi016.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-21T00:33:25.776 INFO:teuthology.orchestra.run.smithi016.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T00:33:25.785 INFO:teuthology.orchestra.run.smithi123.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T00:33:25.793 INFO:teuthology.orchestra.run.smithi178.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-21T00:33:25.810 INFO:teuthology.orchestra.run.smithi016.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T00:33:25.810 INFO:teuthology.orchestra.run.smithi123.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 475 kB/s | 32 kB 00:00 2024-09-21T00:33:25.835 INFO:teuthology.orchestra.run.smithi016.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T00:33:25.860 INFO:teuthology.orchestra.run.smithi016.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T00:33:25.877 INFO:teuthology.orchestra.run.smithi123.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T00:33:25.886 INFO:teuthology.orchestra.run.smithi016.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-21T00:33:25.901 INFO:teuthology.orchestra.run.smithi178.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-09-21T00:33:25.927 INFO:teuthology.orchestra.run.smithi178.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T00:33:25.928 INFO:teuthology.orchestra.run.smithi123.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T00:33:25.978 INFO:teuthology.orchestra.run.smithi016.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-21T00:33:25.985 INFO:teuthology.orchestra.run.smithi178.stdout:(111/157): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-21T00:33:26.002 INFO:teuthology.orchestra.run.smithi123.stdout:(17/157): libcephfs2-19.3.0-5120.g18432218.el9. 3.4 MB/s | 766 kB 00:00 2024-09-21T00:33:26.010 INFO:teuthology.orchestra.run.smithi178.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-09-21T00:33:26.028 INFO:teuthology.orchestra.run.smithi016.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 18 MB/s | 910 kB 00:00 2024-09-21T00:33:26.036 INFO:teuthology.orchestra.run.smithi178.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T00:33:26.070 INFO:teuthology.orchestra.run.smithi016.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-21T00:33:26.078 INFO:teuthology.orchestra.run.smithi178.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T00:33:26.095 INFO:teuthology.orchestra.run.smithi016.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T00:33:26.103 INFO:teuthology.orchestra.run.smithi178.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:33:26.128 INFO:teuthology.orchestra.run.smithi178.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T00:33:26.154 INFO:teuthology.orchestra.run.smithi178.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T00:33:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 2.1 MB/s | 507 kB 00:00 2024-09-21T00:33:26.179 INFO:teuthology.orchestra.run.smithi016.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-21T00:33:26.179 INFO:teuthology.orchestra.run.smithi178.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-21T00:33:26.204 INFO:teuthology.orchestra.run.smithi178.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T00:33:26.221 INFO:teuthology.orchestra.run.smithi016.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-21T00:33:26.238 INFO:teuthology.orchestra.run.smithi178.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T00:33:26.246 INFO:teuthology.orchestra.run.smithi016.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T00:33:26.261 INFO:teuthology.orchestra.run.smithi123.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 452 kB/s | 45 kB 00:00 2024-09-21T00:33:26.263 INFO:teuthology.orchestra.run.smithi178.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T00:33:26.288 INFO:teuthology.orchestra.run.smithi178.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T00:33:26.289 INFO:teuthology.orchestra.run.smithi016.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T00:33:26.322 INFO:teuthology.orchestra.run.smithi178.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T00:33:26.328 INFO:teuthology.orchestra.run.smithi123.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T00:33:26.347 INFO:teuthology.orchestra.run.smithi178.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T00:33:26.363 INFO:teuthology.orchestra.run.smithi016.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T00:33:26.373 INFO:teuthology.orchestra.run.smithi178.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-21T00:33:26.389 INFO:teuthology.orchestra.run.smithi016.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T00:33:26.395 INFO:teuthology.orchestra.run.smithi123.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T00:33:26.398 INFO:teuthology.orchestra.run.smithi178.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-21T00:33:26.414 INFO:teuthology.orchestra.run.smithi016.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T00:33:26.423 INFO:teuthology.orchestra.run.smithi178.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-21T00:33:26.439 INFO:teuthology.orchestra.run.smithi016.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 506 kB/s | 26 kB 00:00 2024-09-21T00:33:26.449 INFO:teuthology.orchestra.run.smithi178.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-21T00:33:26.465 INFO:teuthology.orchestra.run.smithi016.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-09-21T00:33:26.490 INFO:teuthology.orchestra.run.smithi016.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T00:33:26.507 INFO:teuthology.orchestra.run.smithi178.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T00:33:26.512 INFO:teuthology.orchestra.run.smithi123.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 2.7 MB/s | 321 kB 00:00 2024-09-21T00:33:26.516 INFO:teuthology.orchestra.run.smithi016.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-21T00:33:26.533 INFO:teuthology.orchestra.run.smithi178.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:33:26.558 INFO:teuthology.orchestra.run.smithi178.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:33:26.583 INFO:teuthology.orchestra.run.smithi178.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-21T00:33:26.591 INFO:teuthology.orchestra.run.smithi016.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T00:33:26.617 INFO:teuthology.orchestra.run.smithi016.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T00:33:26.625 INFO:teuthology.orchestra.run.smithi178.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T00:33:26.642 INFO:teuthology.orchestra.run.smithi016.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T00:33:26.659 INFO:teuthology.orchestra.run.smithi178.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T00:33:26.667 INFO:teuthology.orchestra.run.smithi016.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T00:33:26.671 INFO:teuthology.orchestra.run.smithi123.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 1.9 MB/s | 307 kB 00:00 2024-09-21T00:33:26.684 INFO:teuthology.orchestra.run.smithi178.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-21T00:33:26.692 INFO:teuthology.orchestra.run.smithi016.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-21T00:33:26.709 INFO:teuthology.orchestra.run.smithi178.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T00:33:26.717 INFO:teuthology.orchestra.run.smithi016.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T00:33:26.735 INFO:teuthology.orchestra.run.smithi178.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T00:33:26.743 INFO:teuthology.orchestra.run.smithi016.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T00:33:26.760 INFO:teuthology.orchestra.run.smithi178.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T00:33:26.768 INFO:teuthology.orchestra.run.smithi016.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T00:33:26.785 INFO:teuthology.orchestra.run.smithi178.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T00:33:26.793 INFO:teuthology.orchestra.run.smithi016.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T00:33:26.804 INFO:teuthology.orchestra.run.smithi123.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 746 kB/s | 99 kB 00:00 2024-09-21T00:33:26.810 INFO:teuthology.orchestra.run.smithi178.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T00:33:26.818 INFO:teuthology.orchestra.run.smithi016.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T00:33:26.836 INFO:teuthology.orchestra.run.smithi178.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T00:33:26.861 INFO:teuthology.orchestra.run.smithi178.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:33:26.880 INFO:teuthology.orchestra.run.smithi123.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.1 MB/s | 86 kB 00:00 2024-09-21T00:33:26.886 INFO:teuthology.orchestra.run.smithi178.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:33:26.902 INFO:teuthology.orchestra.run.smithi016.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T00:33:26.912 INFO:teuthology.orchestra.run.smithi178.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:33:26.928 INFO:teuthology.orchestra.run.smithi016.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-21T00:33:26.937 INFO:teuthology.orchestra.run.smithi178.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 794 kB/s | 20 kB 00:00 2024-09-21T00:33:26.953 INFO:teuthology.orchestra.run.smithi016.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-21T00:33:26.962 INFO:teuthology.orchestra.run.smithi178.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T00:33:26.978 INFO:teuthology.orchestra.run.smithi016.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T00:33:26.987 INFO:teuthology.orchestra.run.smithi178.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:33:27.003 INFO:teuthology.orchestra.run.smithi016.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T00:33:27.029 INFO:teuthology.orchestra.run.smithi016.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-21T00:33:27.046 INFO:teuthology.orchestra.run.smithi178.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T00:33:27.121 INFO:teuthology.orchestra.run.smithi016.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-21T00:33:27.146 INFO:teuthology.orchestra.run.smithi016.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-21T00:33:27.171 INFO:teuthology.orchestra.run.smithi016.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T00:33:27.180 INFO:teuthology.orchestra.run.smithi123.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 4.5 MB/s | 5.3 MB 00:01 2024-09-21T00:33:27.197 INFO:teuthology.orchestra.run.smithi016.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T00:33:27.222 INFO:teuthology.orchestra.run.smithi016.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-21T00:33:27.230 INFO:teuthology.orchestra.run.smithi123.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T00:33:27.289 INFO:teuthology.orchestra.run.smithi016.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-21T00:33:27.289 INFO:teuthology.orchestra.run.smithi123.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 586 kB/s | 34 kB 00:00 2024-09-21T00:33:27.330 INFO:teuthology.orchestra.run.smithi178.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-21T00:33:27.339 INFO:teuthology.orchestra.run.smithi123.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T00:33:27.339 INFO:teuthology.orchestra.run.smithi016.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T00:33:27.373 INFO:teuthology.orchestra.run.smithi016.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T00:33:27.388 INFO:teuthology.orchestra.run.smithi178.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T00:33:27.398 INFO:teuthology.orchestra.run.smithi016.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-21T00:33:27.432 INFO:teuthology.orchestra.run.smithi016.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-21T00:33:27.522 INFO:teuthology.orchestra.run.smithi178.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T00:33:27.556 INFO:teuthology.orchestra.run.smithi123.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 4.6 MB/s | 3.1 MB 00:00 2024-09-21T00:33:27.564 INFO:teuthology.orchestra.run.smithi178.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 975 kB/s | 41 kB 00:00 2024-09-21T00:33:27.616 INFO:teuthology.orchestra.run.smithi016.stdout:(109/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-21T00:33:27.623 INFO:teuthology.orchestra.run.smithi178.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.7 MB/s | 1.8 MB 00:00 2024-09-21T00:33:27.648 INFO:teuthology.orchestra.run.smithi178.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T00:33:27.649 INFO:teuthology.orchestra.run.smithi016.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 120 kB/s | 26 kB 00:00 2024-09-21T00:33:27.675 INFO:teuthology.orchestra.run.smithi016.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-21T00:33:27.690 INFO:teuthology.orchestra.run.smithi178.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T00:33:27.700 INFO:teuthology.orchestra.run.smithi016.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-09-21T00:33:27.725 INFO:teuthology.orchestra.run.smithi016.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T00:33:27.740 INFO:teuthology.orchestra.run.smithi178.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-21T00:33:27.767 INFO:teuthology.orchestra.run.smithi016.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T00:33:27.792 INFO:teuthology.orchestra.run.smithi016.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:33:27.883 INFO:teuthology.orchestra.run.smithi016.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T00:33:27.884 INFO:teuthology.orchestra.run.smithi016.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-21T00:33:27.884 INFO:teuthology.orchestra.run.smithi016.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-21T00:33:27.893 INFO:teuthology.orchestra.run.smithi016.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T00:33:27.927 INFO:teuthology.orchestra.run.smithi016.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T00:33:27.961 INFO:teuthology.orchestra.run.smithi016.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-21T00:33:27.986 INFO:teuthology.orchestra.run.smithi016.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T00:33:28.011 INFO:teuthology.orchestra.run.smithi016.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T00:33:28.037 INFO:teuthology.orchestra.run.smithi016.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T00:33:28.062 INFO:teuthology.orchestra.run.smithi016.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-21T00:33:28.088 INFO:teuthology.orchestra.run.smithi016.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-21T00:33:28.113 INFO:teuthology.orchestra.run.smithi016.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-21T00:33:28.138 INFO:teuthology.orchestra.run.smithi016.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T00:33:28.222 INFO:teuthology.orchestra.run.smithi016.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-09-21T00:33:28.247 INFO:teuthology.orchestra.run.smithi016.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:33:28.272 INFO:teuthology.orchestra.run.smithi016.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:33:28.314 INFO:teuthology.orchestra.run.smithi016.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T00:33:28.340 INFO:teuthology.orchestra.run.smithi016.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 860 kB/s | 58 kB 00:00 2024-09-21T00:33:28.365 INFO:teuthology.orchestra.run.smithi016.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-21T00:33:28.407 INFO:teuthology.orchestra.run.smithi016.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-09-21T00:33:28.436 INFO:teuthology.orchestra.run.smithi016.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.0 MB/s | 28 kB 00:00 2024-09-21T00:33:28.461 INFO:teuthology.orchestra.run.smithi016.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 943 kB/s | 90 kB 00:00 2024-09-21T00:33:28.486 INFO:teuthology.orchestra.run.smithi016.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T00:33:28.520 INFO:teuthology.orchestra.run.smithi016.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-21T00:33:28.545 INFO:teuthology.orchestra.run.smithi016.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-21T00:33:28.571 INFO:teuthology.orchestra.run.smithi016.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T00:33:28.596 INFO:teuthology.orchestra.run.smithi016.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:33:28.621 INFO:teuthology.orchestra.run.smithi016.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T00:33:28.647 INFO:teuthology.orchestra.run.smithi016.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T00:33:28.648 INFO:teuthology.orchestra.run.smithi123.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 6.8 MB/s | 7.4 MB 00:01 2024-09-21T00:33:28.663 INFO:teuthology.orchestra.run.smithi016.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T00:33:28.689 INFO:teuthology.orchestra.run.smithi016.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-21T00:33:28.714 INFO:teuthology.orchestra.run.smithi016.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:33:28.723 INFO:teuthology.orchestra.run.smithi123.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T00:33:28.739 INFO:teuthology.orchestra.run.smithi016.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-21T00:33:28.773 INFO:teuthology.orchestra.run.smithi123.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 988 kB/s | 49 kB 00:00 2024-09-21T00:33:28.790 INFO:teuthology.orchestra.run.smithi016.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:33:28.815 INFO:teuthology.orchestra.run.smithi123.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 397 kB/s | 16 kB 00:00 2024-09-21T00:33:28.815 INFO:teuthology.orchestra.run.smithi178.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-09-21T00:33:28.821 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:33:28.821 INFO:teuthology.orchestra.run.smithi178.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-21T00:33:28.882 INFO:teuthology.orchestra.run.smithi123.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.2 MB/s | 285 kB 00:00 2024-09-21T00:33:28.990 INFO:teuthology.orchestra.run.smithi016.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T00:33:29.058 INFO:teuthology.orchestra.run.smithi123.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 8.3 MB/s | 14 MB 00:01 2024-09-21T00:33:29.108 INFO:teuthology.orchestra.run.smithi123.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 371 kB/s | 18 kB 00:00 2024-09-21T00:33:29.141 INFO:teuthology.orchestra.run.smithi123.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.0 MB/s | 784 kB 00:00 2024-09-21T00:33:29.283 INFO:teuthology.orchestra.run.smithi123.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-21T00:33:29.357 INFO:teuthology.orchestra.run.smithi016.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-09-21T00:33:29.367 INFO:teuthology.orchestra.run.smithi123.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T00:33:29.399 INFO:teuthology.orchestra.run.smithi016.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 990 kB/s | 41 kB 00:00 2024-09-21T00:33:29.400 INFO:teuthology.orchestra.run.smithi123.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-21T00:33:29.426 INFO:teuthology.orchestra.run.smithi123.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T00:33:29.441 INFO:teuthology.orchestra.run.smithi016.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-21T00:33:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T00:33:29.510 INFO:teuthology.orchestra.run.smithi123.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-21T00:33:29.516 INFO:teuthology.orchestra.run.smithi016.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T00:33:29.535 INFO:teuthology.orchestra.run.smithi123.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-21T00:33:29.561 INFO:teuthology.orchestra.run.smithi123.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T00:33:29.603 INFO:teuthology.orchestra.run.smithi123.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T00:33:29.608 INFO:teuthology.orchestra.run.smithi016.stdout:(155/157): librbd1-19.3.0-5120.g18432218.el9.x8 3.6 MB/s | 3.2 MB 00:00 2024-09-21T00:33:29.786 INFO:teuthology.orchestra.run.smithi123.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T00:33:29.820 INFO:teuthology.orchestra.run.smithi123.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-21T00:33:29.845 INFO:teuthology.orchestra.run.smithi123.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-21T00:33:29.870 INFO:teuthology.orchestra.run.smithi123.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T00:33:29.900 INFO:teuthology.orchestra.run.smithi016.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 1.4 MB 00:00 2024-09-21T00:33:29.904 INFO:teuthology.orchestra.run.smithi123.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T00:33:29.929 INFO:teuthology.orchestra.run.smithi123.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-21T00:33:29.971 INFO:teuthology.orchestra.run.smithi123.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-21T00:33:30.022 INFO:teuthology.orchestra.run.smithi123.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T00:33:30.054 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-21T00:33:30.080 INFO:teuthology.orchestra.run.smithi123.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-21T00:33:30.105 INFO:teuthology.orchestra.run.smithi123.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T00:33:30.139 INFO:teuthology.orchestra.run.smithi123.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T00:33:30.164 INFO:teuthology.orchestra.run.smithi123.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-21T00:33:30.198 INFO:teuthology.orchestra.run.smithi123.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T00:33:30.205 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-21T00:33:30.205 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-21T00:33:30.225 INFO:teuthology.orchestra.run.smithi016.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-21T00:33:30.231 INFO:teuthology.orchestra.run.smithi123.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-21T00:33:30.232 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:33:30.232 INFO:teuthology.orchestra.run.smithi016.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-21T00:33:30.257 INFO:teuthology.orchestra.run.smithi123.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T00:33:30.282 INFO:teuthology.orchestra.run.smithi123.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T00:33:30.307 INFO:teuthology.orchestra.run.smithi123.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T00:33:30.333 INFO:teuthology.orchestra.run.smithi123.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T00:33:30.358 INFO:teuthology.orchestra.run.smithi123.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T00:33:30.525 INFO:teuthology.orchestra.run.smithi123.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-21T00:33:30.584 INFO:teuthology.orchestra.run.smithi123.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-21T00:33:30.625 INFO:teuthology.orchestra.run.smithi123.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:33:30.659 INFO:teuthology.orchestra.run.smithi123.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T00:33:30.693 INFO:teuthology.orchestra.run.smithi123.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T00:33:30.752 INFO:teuthology.orchestra.run.smithi123.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-21T00:33:30.827 INFO:teuthology.orchestra.run.smithi123.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-21T00:33:30.852 INFO:teuthology.orchestra.run.smithi123.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-21T00:33:30.894 INFO:teuthology.orchestra.run.smithi123.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T00:33:30.978 INFO:teuthology.orchestra.run.smithi123.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-21T00:33:31.003 INFO:teuthology.orchestra.run.smithi123.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T00:33:31.037 INFO:teuthology.orchestra.run.smithi123.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T00:33:31.062 INFO:teuthology.orchestra.run.smithi123.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-21T00:33:31.087 INFO:teuthology.orchestra.run.smithi123.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T00:33:31.121 INFO:teuthology.orchestra.run.smithi123.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T00:33:31.146 INFO:teuthology.orchestra.run.smithi123.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-21T00:33:31.196 INFO:teuthology.orchestra.run.smithi123.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-21T00:33:31.272 INFO:teuthology.orchestra.run.smithi123.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-21T00:33:31.297 INFO:teuthology.orchestra.run.smithi123.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-21T00:33:31.322 INFO:teuthology.orchestra.run.smithi123.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T00:33:31.347 INFO:teuthology.orchestra.run.smithi123.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T00:33:31.373 INFO:teuthology.orchestra.run.smithi123.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T00:33:31.406 INFO:teuthology.orchestra.run.smithi123.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T00:33:31.440 INFO:teuthology.orchestra.run.smithi123.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-21T00:33:31.465 INFO:teuthology.orchestra.run.smithi123.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-21T00:33:31.490 INFO:teuthology.orchestra.run.smithi123.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T00:33:31.506 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-09-21T00:33:31.532 INFO:teuthology.orchestra.run.smithi123.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T00:33:31.574 INFO:teuthology.orchestra.run.smithi123.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T00:33:31.624 INFO:teuthology.orchestra.run.smithi123.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T00:33:31.677 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-09-21T00:33:31.677 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-09-21T00:33:31.683 INFO:teuthology.orchestra.run.smithi123.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-21T00:33:31.850 INFO:teuthology.orchestra.run.smithi123.stdout:(97/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-21T00:33:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-09-21T00:33:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T00:33:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 982 kB/s | 58 kB 00:00 2024-09-21T00:33:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T00:33:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T00:33:32.008 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-21T00:33:32.008 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-21T00:33:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T00:33:32.094 INFO:teuthology.orchestra.run.smithi123.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-21T00:33:32.153 INFO:teuthology.orchestra.run.smithi123.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T00:33:32.186 INFO:teuthology.orchestra.run.smithi123.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T00:33:32.212 INFO:teuthology.orchestra.run.smithi123.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-21T00:33:32.237 INFO:teuthology.orchestra.run.smithi123.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-21T00:33:32.596 INFO:teuthology.orchestra.run.smithi123.stdout:(109/157): ceph-test-19.3.0-5120.g18432218.el9. 5.4 MB/s | 40 MB 00:07 2024-09-21T00:33:32.621 INFO:teuthology.orchestra.run.smithi123.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 68 kB/s | 26 kB 00:00 2024-09-21T00:33:32.654 INFO:teuthology.orchestra.run.smithi123.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:33:32.688 INFO:teuthology.orchestra.run.smithi123.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-09-21T00:33:32.721 INFO:teuthology.orchestra.run.smithi123.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-09-21T00:33:32.772 INFO:teuthology.orchestra.run.smithi123.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T00:33:32.789 INFO:teuthology.orchestra.run.smithi123.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T00:33:32.805 INFO:teuthology.orchestra.run.smithi123.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T00:33:32.881 INFO:teuthology.orchestra.run.smithi123.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-21T00:33:32.906 INFO:teuthology.orchestra.run.smithi123.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 141 kB/s | 14 kB 00:00 2024-09-21T00:33:32.940 INFO:teuthology.orchestra.run.smithi123.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-21T00:33:32.965 INFO:teuthology.orchestra.run.smithi123.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-21T00:33:32.999 INFO:teuthology.orchestra.run.smithi123.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-21T00:33:33.024 INFO:teuthology.orchestra.run.smithi123.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-21T00:33:33.049 INFO:teuthology.orchestra.run.smithi123.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T00:33:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T00:33:33.108 INFO:teuthology.orchestra.run.smithi123.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-21T00:33:33.133 INFO:teuthology.orchestra.run.smithi123.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-21T00:33:33.159 INFO:teuthology.orchestra.run.smithi123.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T00:33:33.184 INFO:teuthology.orchestra.run.smithi123.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T00:33:33.209 INFO:teuthology.orchestra.run.smithi123.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T00:33:33.234 INFO:teuthology.orchestra.run.smithi123.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:33:33.260 INFO:teuthology.orchestra.run.smithi123.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:33:33.285 INFO:teuthology.orchestra.run.smithi123.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:33:33.327 INFO:teuthology.orchestra.run.smithi123.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-21T00:33:33.353 INFO:teuthology.orchestra.run.smithi123.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-21T00:33:33.377 INFO:teuthology.orchestra.run.smithi123.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T00:33:33.403 INFO:teuthology.orchestra.run.smithi123.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-21T00:33:33.436 INFO:teuthology.orchestra.run.smithi123.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 485 kB/s | 28 kB 00:00 2024-09-21T00:33:33.462 INFO:teuthology.orchestra.run.smithi123.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-21T00:33:33.487 INFO:teuthology.orchestra.run.smithi123.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T00:33:33.512 INFO:teuthology.orchestra.run.smithi123.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T00:33:33.587 INFO:teuthology.orchestra.run.smithi123.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-09-21T00:33:33.613 INFO:teuthology.orchestra.run.smithi123.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 742 kB/s | 74 kB 00:00 2024-09-21T00:33:33.655 INFO:teuthology.orchestra.run.smithi123.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T00:33:33.680 INFO:teuthology.orchestra.run.smithi123.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-21T00:33:33.705 INFO:teuthology.orchestra.run.smithi123.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-21T00:33:33.731 INFO:teuthology.orchestra.run.smithi123.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T00:33:33.756 INFO:teuthology.orchestra.run.smithi123.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:33:33.781 INFO:teuthology.orchestra.run.smithi123.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T00:33:33.831 INFO:teuthology.orchestra.run.smithi123.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T00:33:34.066 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-09-21T00:33:34.066 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-09-21T00:33:34.107 INFO:teuthology.orchestra.run.smithi123.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-09-21T00:33:34.207 INFO:teuthology.orchestra.run.smithi123.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.4 MB/s | 3.2 MB 00:00 2024-09-21T00:33:34.249 INFO:teuthology.orchestra.run.smithi123.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-09-21T00:33:34.316 INFO:teuthology.orchestra.run.smithi123.stdout:(153/157): librados2-19.3.0-5120.g18432218.el9. 6.1 MB/s | 3.4 MB 00:00 2024-09-21T00:33:34.333 INFO:teuthology.orchestra.run.smithi123.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 326 kB/s | 41 kB 00:00 2024-09-21T00:33:34.358 INFO:teuthology.orchestra.run.smithi123.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-21T00:33:34.500 INFO:teuthology.orchestra.run.smithi123.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-21T00:33:34.675 INFO:teuthology.orchestra.run.smithi123.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 2.4 MB 00:00 2024-09-21T00:33:34.682 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:33:34.682 INFO:teuthology.orchestra.run.smithi123.stdout:Total 14 MB/s | 228 MB 00:16 2024-09-21T00:33:35.936 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-21T00:33:36.087 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-21T00:33:36.087 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-21T00:33:37.891 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-21T00:33:37.892 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-21T00:33:38.343 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-21T00:33:38.444 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:33:38.557 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:33:38.761 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:33:38.794 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:33:38.820 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:33:38.871 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:33:39.211 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:33:39.380 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:39.504 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:39.531 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:39.622 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:39.651 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:33:39.689 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:33:39.849 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:33:39.907 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:33:39.935 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:40.041 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:40.070 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:40.132 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:40.154 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:40.180 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:40.364 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:40.504 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:40.627 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:33:40.700 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-09-21T00:33:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:40.795 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:40.805 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:33:40.945 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:33:41.009 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:41.118 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:33:41.119 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:33:41.152 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:33:41.157 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:33:41.187 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:33:41.189 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:33:41.258 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:33:41.268 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:33:41.313 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:33:41.354 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:33:41.397 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:33:41.430 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:33:41.458 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:33:41.534 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:33:41.596 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:33:41.627 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:33:41.649 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:33:41.662 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:33:41.770 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:33:41.782 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:41.807 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:33:41.851 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:33:41.879 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:33:41.912 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:41.941 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:41.950 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:33:42.003 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:33:42.034 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:42.063 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:33:42.078 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:33:42.093 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:33:42.213 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:33:42.281 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:33:42.285 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:33:42.344 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:33:42.372 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:42.490 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:42.514 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:42.578 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:42.608 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:42.636 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:42.823 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:33:42.837 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:42.910 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:33:42.937 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:33:42.980 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:33:43.018 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:33:43.049 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:43.068 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:33:43.156 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:33:43.220 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:33:43.274 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:43.280 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:33:43.341 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:33:43.445 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:33:43.518 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:33:43.548 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:33:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:43.584 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:33:43.632 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:33:43.667 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:33:43.692 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:33:43.711 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:33:43.721 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:33:43.756 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:33:43.844 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:33:43.847 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:33:43.899 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:33:43.939 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:33:43.983 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:33:44.016 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:33:44.051 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:33:44.068 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:33:44.121 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:33:44.124 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:33:44.162 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:33:44.183 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:33:44.213 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:33:44.257 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:33:44.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:33:44.304 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:33:44.340 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:33:44.344 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:33:44.367 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-21T00:33:44.376 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:33:44.378 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:33:44.411 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:33:44.419 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:33:44.448 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:33:44.494 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:33:44.504 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:33:44.521 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:33:44.542 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:33:44.580 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:33:44.595 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:33:44.629 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:33:44.629 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:33:44.654 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:33:44.666 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:33:44.679 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:33:44.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:33:44.706 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:33:44.749 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:33:44.818 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:33:44.844 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:33:44.875 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:33:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:33:45.040 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:33:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:45.204 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:33:45.234 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:33:45.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:33:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:33:45.309 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:33:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:45.343 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:33:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:33:45.428 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:33:45.431 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:33:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:33:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:33:45.482 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:33:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:33:45.513 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:33:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:33:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:33:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:33:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:33:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:33:45.680 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:33:45.681 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:33:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:33:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:33:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:45.856 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:33:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:33:45.908 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:33:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:33:46.012 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:33:46.073 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:33:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:46.148 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:33:46.185 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:33:46.221 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:33:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:33:46.269 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:33:46.312 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:33:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:33:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:33:46.398 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:33:46.408 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:33:46.461 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:33:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:46.503 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:33:46.541 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:46.543 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:33:46.601 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:33:46.650 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:33:46.695 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:33:46.711 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:33:46.753 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:33:46.771 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:33:46.782 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:33:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:33:46.859 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:33:46.895 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:33:46.901 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:33:46.935 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:33:46.937 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:33:46.968 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:33:46.972 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:33:46.993 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:33:46.998 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:33:47.028 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:33:47.046 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:33:47.089 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:33:47.090 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:33:47.105 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:33:47.130 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:33:47.173 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:33:47.206 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:33:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:33:47.234 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:33:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:33:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:33:47.311 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:33:47.321 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:33:47.369 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:33:47.372 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:33:47.403 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:33:47.409 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:33:47.438 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:33:47.439 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:33:47.473 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:33:47.507 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:33:47.520 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:33:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:33:47.557 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:33:47.583 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:33:47.601 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:33:47.629 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:33:47.674 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:33:47.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:33:47.722 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:33:47.752 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:33:47.755 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:33:47.762 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:33:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:33:47.868 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:33:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:33:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:33:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:33:48.012 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:33:48.531 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:33:48.624 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:33:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:33:48.700 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:33:48.704 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:33:48.742 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:33:48.746 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:33:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:33:48.784 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:33:48.909 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:33:48.938 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:33:48.961 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:33:49.003 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:33:49.014 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:33:49.091 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:33:49.093 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:33:49.105 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:33:49.141 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:33:49.151 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:33:49.174 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:33:49.201 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:33:49.223 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:33:49.235 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:33:49.255 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:33:49.291 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:33:49.332 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:33:49.338 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:33:49.355 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:33:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:33:49.425 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:33:49.435 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:33:49.468 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:33:49.558 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:33:49.598 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:49.604 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:33:49.644 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:33:49.685 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:33:49.689 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:49.719 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:33:49.755 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:33:49.787 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:33:49.827 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:33:49.875 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:33:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:33:50.115 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:33:50.156 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:33:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:33:50.268 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:33:50.274 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:33:50.300 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:50.363 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:33:50.417 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:33:50.647 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:33:50.793 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:33:50.830 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:33:50.870 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:33:50.918 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:33:50.947 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:33:50.982 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:33:51.024 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:33:51.065 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:33:51.100 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:33:51.187 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:33:51.238 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:33:51.278 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:33:51.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:33:51.445 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:33:51.555 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:33:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:33:51.772 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:33:51.805 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:33:52.148 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:33:52.167 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:33:52.193 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:52.217 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:33:52.252 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:33:52.294 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:33:52.349 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:33:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:33:52.407 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:33:52.451 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:33:52.538 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:33:52.571 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:33:52.585 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:52.632 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:52.755 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:33:52.785 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:33:52.862 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:33:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:33:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:52.984 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:53.014 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:33:53.202 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:53.243 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:53.319 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:53.319 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:33:53.319 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:33:53.319 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:33:53.353 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:33:53.490 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:33:53.607 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:33:54.820 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:33:54.905 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:33:54.932 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:33:54.966 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:33:55.290 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:33:55.337 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:55.428 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:33:55.458 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:33:55.494 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:33:55.752 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:55.992 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:33:56.015 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:56.086 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:33:56.117 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:33:56.425 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:56.559 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:33:56.559 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:33:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:33:56.610 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:33:58.416 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:58.446 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:33:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:59.139 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:33:59.139 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:33:59.139 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:33:59.139 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:33:59.167 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-09-21T00:34:05.255 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:05.445 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:05.445 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:05.445 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:34:05.445 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:07.033 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:07.060 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:07.283 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:07.306 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:07.307 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:07.307 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:34:07.307 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:07.307 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:07.307 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:07.776 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:07.800 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:07.906 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:34:07.971 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:34:08.027 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:34:08.210 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:34:08.259 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:34:08.345 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:34:08.434 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:34:08.590 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:34:08.626 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:34:08.658 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:34:08.694 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:34:09.038 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:34:09.038 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-09-21T00:34:09.038 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-09-21T00:34:09.038 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-09-21T00:34:09.039 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-09-21T00:34:09.039 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-09-21T00:34:09.039 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-09-21T00:34:09.039 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-09-21T00:34:09.039 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:09.154 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:09.184 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:09.217 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:34:09.223 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:09.240 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:09.240 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:09.240 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:34:09.240 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:09.283 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:34:09.308 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:10.859 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:34:10.859 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-09-21T00:34:10.860 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:10.893 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:10.922 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:11.028 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:11.045 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:34:11.045 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:11.045 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:34:11.045 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:11.160 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:11.186 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:11.678 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:11.703 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:11.817 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:34:11.884 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:34:11.948 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:34:12.144 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:34:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:34:12.286 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:34:12.383 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:34:12.484 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:12.536 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:34:12.538 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:12.581 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:34:12.620 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:34:12.622 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:34:12.650 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:12.656 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:34:12.873 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:12.897 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:34:12.897 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:12.897 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:34:12.898 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:12.898 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:34:12.898 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:13.119 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:13.147 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:13.180 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:34:13.249 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:34:13.278 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:13.365 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:34:13.389 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:13.495 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:34:13.504 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:13.530 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:13.552 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:34:13.607 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:34:13.645 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:13.791 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:34:13.806 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:34:13.833 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:13.841 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:34:13.856 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:13.856 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:13.857 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:34:13.857 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:13.857 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:13.857 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:13.908 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:13.920 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:13.927 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:34:14.018 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:34:14.023 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:34:14.065 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:34:14.163 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:34:14.199 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:34:14.232 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:34:14.259 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:34:14.727 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:14.758 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:34:14.790 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:34:14.856 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:34:14.881 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:15.028 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:34:15.061 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:15.084 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:15.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:15.151 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:15.151 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:15.151 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:34:15.151 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:15.203 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:15.227 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:15.546 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:15.570 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:16.718 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:17.890 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:18.069 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:34:18.078 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:34:18.104 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:18.130 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:18.145 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:18.180 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:18.192 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:18.295 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:34:18.354 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:34:19.112 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:34:19.137 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:19.250 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:34:19.374 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:34:19.407 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:19.413 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:19.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:19.439 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:34:19.463 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:19.474 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:19.499 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:19.499 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:34:19.499 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:19.523 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:19.535 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:34:19.550 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:19.558 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:34:19.575 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:19.575 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:19.576 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:34:19.576 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:19.576 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:19.576 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:19.599 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:34:19.633 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:34:19.640 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:34:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:34:19.687 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:34:19.699 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:34:19.880 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:34:19.909 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:19.929 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:34:19.934 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:19.935 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:19.935 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:34:19.935 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:19.935 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:19.935 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:19.968 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:34:19.997 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:34:20.044 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:34:20.664 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:20.666 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:34:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:20.700 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:20.720 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:34:20.724 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:20.768 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:20.791 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:34:20.791 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:20.791 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:34:20.791 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:20.843 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:20.866 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:34:20.866 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:20.867 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:34:20.867 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:20.867 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:34:20.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:21.194 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:21.217 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:34:21.217 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:34:21.218 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:34:21.218 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:21.218 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:34:21.218 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:21.549 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:34:21.629 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:34:21.678 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:34:21.767 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:34:21.807 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:34:21.833 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:34:21.859 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:34:21.859 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:21.935 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:21.935 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:22.019 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:22.043 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:34:22.049 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:22.049 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:22.229 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:22.229 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:22.321 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:22.384 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:34:24.248 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:34:24.289 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:34:24.328 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:34:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:34:24.600 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:34:24.644 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:34:24.674 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:34:24.704 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:34:24.750 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:34:25.206 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:34:25.261 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:34:25.312 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:34:25.345 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:34:25.349 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:25.372 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:34:25.390 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:25.412 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:25.553 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:34:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:34:25.624 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:34:25.653 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:34:25.700 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:34:26.295 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:34:26.331 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:26.351 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:34:26.412 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:34:26.462 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:34:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:34:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:34:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:34:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:34:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:26.743 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:26.743 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:34:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:27.037 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:27.037 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:27.129 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:27.179 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:34:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:27.268 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:34:27.309 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:34:27.391 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:34:27.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:34:27.455 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:34:27.481 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:34:27.481 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:27.582 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:34:27.582 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:27.674 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:34:27.699 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:34:27.705 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:27.705 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:27.892 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:34:27.893 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:27.960 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:34:28.023 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:28.781 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:28.781 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:34:28.781 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:34:28.782 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:34:28.783 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:34:28.784 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:34:28.785 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:34:28.786 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:34:28.787 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:34:28.788 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:34:28.789 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:34:28.790 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:34:28.791 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:34:28.792 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:34:31.573 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:31.573 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:31.573 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-09-21T00:34:31.573 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:34:31.574 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.575 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:34:31.576 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:34:31.577 INFO:teuthology.orchestra.run.smithi178.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:34:31.578 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:34:31.579 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:34:31.580 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:34:31.581 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:34:31.582 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:34:31.583 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.584 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:34:31.585 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-21T00:34:32.009 DEBUG:teuthology.parallel:result is None 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:34:33.938 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:34:33.939 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:34:33.940 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:34:33.952 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:34:33.953 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:34:33.954 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:34:33.955 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:34:33.956 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:34:33.957 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:34:33.958 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:34:33.959 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:34:33.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:34:33.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:34:33.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:34:33.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:34:33.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:34:34.360 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:34:34.361 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:34:34.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:34:34.362 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:34:34.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:34:34.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:34:34.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:34:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:34:34.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:34:34.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:34:34.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:34:34.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:34:34.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:34:34.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:34:34.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:34:36.665 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:36.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:36.665 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:34:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:34:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:34:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:34:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:34:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:34:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:34:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.677 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:34:36.678 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.972 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.973 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.974 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:34:36.975 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.976 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:34:36.977 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:34:36.978 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:34:36.979 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:36.980 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.981 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:34:36.982 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:34:36.983 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:34:36.984 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:34:36.984 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:34:36.984 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:34:36.984 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-21T00:34:37.209 DEBUG:teuthology.parallel:result is None 2024-09-21T00:34:37.413 DEBUG:teuthology.parallel:result is None 2024-09-21T00:34:37.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:37.564 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:34:37.591 INFO:teuthology.orchestra.run.smithi016.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.592 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.592 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:34:37.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:37.734 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:34:37.757 INFO:teuthology.orchestra.run.smithi123.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.758 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.758 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:34:37.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:37.899 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:34:37.925 INFO:teuthology.orchestra.run.smithi178.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.926 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:34:37.926 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:34:37.927 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T00:34:37.928 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:34:37.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:34:37.961 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:34:37.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:34:37.990 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:34:37.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:34:38.021 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T00:34:38.022 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:34:38.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:34:38.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:34:38.121 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:34:38.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:34:38.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:34:38.214 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:34:38.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:34:38.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:34:38.312 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T00:34:38.312 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:34:38.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:34:38.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:34:38.412 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:34:38.413 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:34:38.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:34:38.503 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:34:38.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:34:38.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:34:38.603 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T00:34:38.603 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:34:38.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:34:38.634 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:34:38.703 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:34:38.704 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:34:38.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:34:38.793 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:34:38.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:34:38.823 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:34:38.891 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T00:34:38.981 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T00:34:38.981 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:38.982 INFO:tasks.cephadm:Cluster fsid is 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:34:38.982 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T00:34:38.982 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.16', 'mon.b': '172.21.15.123', 'mon.c': '172.21.15.178'} 2024-09-21T00:34:38.982 INFO:tasks.cephadm:First mon is mon.a on smithi016 2024-09-21T00:34:38.982 INFO:tasks.cephadm:First mgr is x 2024-09-21T00:34:38.983 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T00:34:38.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2024-09-21T00:34:39.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-09-21T00:34:39.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2024-09-21T00:34:39.069 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T00:34:39.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:39.212 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T00:34:39.351 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:34:39.353 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:34:39.353 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:34:39.353 DEBUG:teuthology.orchestra.run.smithi016:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:40.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:34 /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:40.202 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:40.753 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:34 /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:40.753 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:41.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:34 /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:41.305 DEBUG:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:41.325 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:41.345 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:34:41.378 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T00:34:41.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:34:41.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:34:41.388 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:34:42.987 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:34:43.003 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:34:43.059 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-21T00:35:14.796 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T00:35:28.261 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-21T00:35:28.261 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:35:28.262 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:35:28.262 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2024-09-21T00:35:28.262 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:35:28.262 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2024-09-21T00:35:28.262 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-21T00:35:37.395 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:35:37.395 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:35:37.396 INFO:teuthology.orchestra.run.smithi016.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:35:37.396 INFO:teuthology.orchestra.run.smithi016.stdout: "repo_digests": [ 2024-09-21T00:35:37.396 INFO:teuthology.orchestra.run.smithi016.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:35:37.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:35:37.396 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:35:37.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2024-09-21T00:35:37.472 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-09-21T00:35:37.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2024-09-21T00:35:37.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2024-09-21T00:35:37.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-09-21T00:35:37.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2024-09-21T00:35:37.623 INFO:tasks.cephadm:Writing seed config... 2024-09-21T00:35:37.624 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T00:35:37.624 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T00:35:37.625 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T00:35:37.626 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T00:35:37.627 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:35:37.627 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T00:35:37.643 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 49060640-77b1-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T00:35:37.643 DEBUG:teuthology.orchestra.run.smithi016:mon.a> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T00:35:37.685 DEBUG:teuthology.orchestra.run.smithi016:mgr.x> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T00:35:37.728 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T00:35:37.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 49060640-77b1-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:35:37.938 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:35:37.938 INFO:teuthology.orchestra.run.smithi016.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.16', '--skip-admin-label'] 2024-09-21T00:35:37.938 INFO:teuthology.orchestra.run.smithi016.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T00:35:37.939 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying podman|docker is present... 2024-09-21T00:35:37.963 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:35:37.963 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying lvm2 is present... 2024-09-21T00:35:37.963 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying time synchronization is in place... 2024-09-21T00:35:37.974 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:35:37.974 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:35:37.978 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:35:37.978 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:35:37.984 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-09-21T00:35:37.991 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-09-21T00:35:37.991 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:35:37.991 INFO:teuthology.orchestra.run.smithi016.stdout:Repeating the final host check... 2024-09-21T00:35:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:35:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T00:35:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl is present 2024-09-21T00:35:38.015 INFO:teuthology.orchestra.run.smithi016.stdout:lvcreate is present 2024-09-21T00:35:38.022 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:35:38.022 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:35:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:35:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:35:38.035 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Host looks OK 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Cluster fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Acquiring lock 139633250654576 on /run/cephadm/49060640-77b1-11ef-baf5-efdc52797490.lock 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Lock 139633250654576 acquired on /run/cephadm/49060640-77b1-11ef-baf5-efdc52797490.lock 2024-09-21T00:35:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 3300 ... 2024-09-21T00:35:38.043 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 6789 ... 2024-09-21T00:35:38.043 INFO:teuthology.orchestra.run.smithi016.stdout:Base mon IP(s) is [172.21.15.16:3300, 172.21.15.16:6789], mon addrv is [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-21T00:35:38.046 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.16 metric 100 2024-09-21T00:35:38.046 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.16 metric 100 2024-09-21T00:35:38.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T00:35:38.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T00:35:38.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-21T00:35:38.051 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-09-21T00:35:38.052 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-09-21T00:35:38.053 INFO:teuthology.orchestra.run.smithi016.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T00:35:38.053 INFO:teuthology.orchestra.run.smithi016.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T00:35:38.054 INFO:teuthology.orchestra.run.smithi016.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:35:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T00:35:39.521 INFO:teuthology.orchestra.run.smithi016.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:35:39.522 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:35:39.522 INFO:teuthology.orchestra.run.smithi016.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T00:35:40.452 INFO:teuthology.orchestra.run.smithi016.stdout:stat: stdout 167 167 2024-09-21T00:35:40.452 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial keys... 2024-09-21T00:35:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQDcFO5mX/2nLxAA0BkNnD+8gfIU0ofU+Ac1CA== 2024-09-21T00:35:42.404 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQDdFO5mElBAMRAAeNvri14yGJUxJQxxqeyQeQ== 2024-09-21T00:35:49.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQDfFO5mkjBlABAAHMHmBbM1nygYn3kwodTfUg== 2024-09-21T00:35:49.760 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial monmap... 2024-09-21T00:35:54.657 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool for a [v2:172.21.15.16:3300,v1:172.21.15.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: set fsid to 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:35:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mon... 2024-09-21T00:35:56.038 INFO:teuthology.orchestra.run.smithi016.stdout:create mon.a on 2024-09-21T00:35:56.255 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T00:35:56.420 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T00:35:56.618 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-49060640-77b1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490.target. 2024-09-21T00:35:56.618 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-49060640-77b1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490.target. 2024-09-21T00:35:56.858 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a 2024-09-21T00:35:56.858 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T00:35:57.036 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490.target.wants/ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490@.service. 2024-09-21T00:35:57.527 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:57 smithi016 podman[30562]: 2024-09-21 00:35:57.475829545 +0000 UTC m=+0.316227660 container start 1f6498c56c19c72f804b713a4a20255b4332168edeee49cd70d4546dd3ca1b16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T00:35:57.567 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:35:57.567 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon to start... 2024-09-21T00:35:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon... 2024-09-21T00:35:57.789 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:57 smithi016 ceph-mon[30581]: mkfs 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:57.789 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:57 smithi016 ceph-mon[30581]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:35:57.789 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:57 smithi016 bash[30562]: 1f6498c56c19c72f804b713a4a20255b4332168edeee49cd70d4546dd3ca1b16 2024-09-21T00:35:57.789 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:57 smithi016 systemd[1]: Started Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:35:58.651 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout id: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout services: 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.538835s) 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout data: 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T00:35:58.652 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T00:35:58.653 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T00:35:58.653 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:35:58.653 INFO:teuthology.orchestra.run.smithi016.stdout:mon is available 2024-09-21T00:35:58.653 INFO:teuthology.orchestra.run.smithi016.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T00:35:58.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:35:58.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: monmap epoch 1 2024-09-21T00:35:58.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:35:58.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: last_changed 2024-09-21T00:35:52.710580+0000 2024-09-21T00:35:58.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:35:58.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: min_mon_release 19 (squid) 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: election_strategy: 1 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: fsmap 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: mgrmap e1: no daemons active 2024-09-21T00:35:58.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:58 smithi016 ceph-mon[30581]: from='client.? 172.21.15.16:0/2588250591' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T00:36:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:59 smithi016 ceph-mon[30581]: from='client.? 172.21.15.16:0/2025914650' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:36:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:35:59 smithi016 ceph-mon[30581]: from='client.? 172.21.15.16:0/2025914650' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:36:00.379 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:36:00.380 INFO:teuthology.orchestra.run.smithi016.stdout:Generating new minimal ceph.conf... 2024-09-21T00:36:01.221 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:00 smithi016 ceph-mon[30581]: from='client.? 172.21.15.16:0/2499346416' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:36:01.441 INFO:teuthology.orchestra.run.smithi016.stdout:Restarting the monitor... 2024-09-21T00:36:01.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:01 smithi016 systemd[1]: Stopping Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:36:02.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:01 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a[30577]: 2024-09-21T00:36:01.732+0000 7fa33f6c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:36:02.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:01 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a[30577]: 2024-09-21T00:36:01.732+0000 7fa33f6c3640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T00:36:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:01 smithi016 podman[30824]: 2024-09-21 00:36:01.896692195 +0000 UTC m=+0.286628694 container died 1f6498c56c19c72f804b713a4a20255b4332168edeee49cd70d4546dd3ca1b16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T00:36:02.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 podman[30824]: 2024-09-21 00:36:02.215951581 +0000 UTC m=+0.605888087 container cleanup 1f6498c56c19c72f804b713a4a20255b4332168edeee49cd70d4546dd3ca1b16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T00:36:02.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 bash[30824]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a 2024-09-21T00:36:02.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 podman[30837]: 2024-09-21 00:36:02.366627817 +0000 UTC m=+0.459397932 container remove 1f6498c56c19c72f804b713a4a20255b4332168edeee49cd70d4546dd3ca1b16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T00:36:02.917 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T00:36:02.917 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 systemd[1]: Stopped Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:36:02.917 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 systemd[1]: Starting Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:36:02.917 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 podman[30928]: 2024-09-21 00:36:02.706543821 +0000 UTC m=+0.016790400 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:36:02.917 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:02 smithi016 podman[30928]: 2024-09-21 00:36:02.809166396 +0000 UTC m=+0.119412962 container create 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T00:36:03.066 INFO:teuthology.orchestra.run.smithi016.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T00:36:03.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 podman[30928]: 2024-09-21 00:36:03.00306788 +0000 UTC m=+0.313314456 container init 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:36:03.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 podman[30928]: 2024-09-21 00:36:03.006397257 +0000 UTC m=+0.316643832 container start 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T00:36:03.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:36:03.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:36:03.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: pidfile_write: ignore empty --pid-file 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: load: jerasure load: lrc 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Git sha 0 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: DB SUMMARY 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: DB Session ID: QETZGYOPQ9AY8GNY32TU 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94810 ; 2024-09-21T00:36:03.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.env: 0x5626b5557d60 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.info_log: 0x5626bab2d360 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.statistics: (nil) 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.use_fsync: 0 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:36:03.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.db_log_dir: 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.wal_dir: 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:36:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.write_buffer_manager: 0x5626bab31d60 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:36:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.unordered_write: 0 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.row_cache: None 2024-09-21T00:36:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.wal_filter: None 2024-09-21T00:36:03.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:36:03.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:36:03.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:36:03.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.wal_compression: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:36:03.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_open_files: -1 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:36:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Compression algorithms supported: 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kZSTD supported: 0 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T00:36:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.merge_operator: 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_filter: None 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5626bab2cfa0) 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:36:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_type: 0 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_index_type: 0 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_shortening: 1 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: checksum: 4 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: no_block_cache: 0 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache: 0x5626b6af1610 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_options: 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: capacity : 536870912 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_shard_bits : 4 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: strict_capacity_limit : 0 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_compressed: (nil) 2024-09-21T00:36:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout: persistent_cache: (nil) 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size: 4096 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size_deviation: 10 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_restart_interval: 16 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_block_restart_interval: 1 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: metadata_block_size: 4096 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: partition_filters: 0 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_delta_encoding: 1 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: filter_policy: bloomfilter 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: whole_key_filtering: 1 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: verify_compression: 0 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: format_version: 5 2024-09-21T00:36:03.272 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_index_compression: 1 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_align: 0 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout: max_auto_readahead_size: 262144 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout: prepopulate_block_cache: 0 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression: NoCompression 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:36:03.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.num_levels: 7 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:36:03.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:36:03.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:36:03.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:36:03.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:36:03.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.ttl: 2592000 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:36:03.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fd69de32-cf63-423a-9ab9-4b27678f5c12 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726878963043066, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726878963044274, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91061, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 89102, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11597, "raw_average_key_size": 47, "raw_value_size": 82510, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726878963, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fd69de32-cf63-423a-9ab9-4b27678f5c12", "db_session_id": "QETZGYOPQ9AY8GNY32TU", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726878963044372, "job": 1, "event": "recovery_finished"} 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5626bab50a80 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: DB pointer 0x5626bb8f6000 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:36:03.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** DB Stats ** 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: L0 2/0 90.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:36:03.281 INFO:journalctl@ceph.mon.a.smithi016.stdout: Sum 2/0 90.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:36:03.282 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative compaction: 0.00 GB write, 24.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval compaction: 0.00 GB write, 24.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache BinnedLRUCache@0x5626b6af1610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: starting mon.a rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???) e1 preinit fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).mds e1 new map 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).mds e1 print_map 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: e1 2024-09-21T00:36:03.283 INFO:journalctl@ceph.mon.a.smithi016.stdout: btime 2024-09-21T00:35:57:524567+0000 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout: legacy client fscid: -1 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout: No filesystems configured 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 ceph-mon[30947]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 bash[30928]: 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 2024-09-21T00:36:03.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:03 smithi016 systemd[1]: Started Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:36:04.112 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T00:36:04.134 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:36:04.134 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mgr... 2024-09-21T00:36:04.135 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T00:36:04.135 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T00:36:04.396 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T00:36:04.396 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T00:36:04.403 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:36:04.403 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: monmap epoch 1 2024-09-21T00:36:04.403 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: last_changed 2024-09-21T00:35:52.710580+0000 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: election_strategy: 1 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: fsmap 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: mgrmap e1: no daemons active 2024-09-21T00:36:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:04 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1443537599' entity='client.admin' 2024-09-21T00:36:04.548 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490.target.wants/ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-49060640-77b1-11ef-baf5-efdc52797490@.service. 2024-09-21T00:36:04.760 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:04 smithi016 systemd[1]: Starting Ceph mgr.x for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:36:05.048 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:04 smithi016 podman[31161]: 2024-09-21 00:36:04.778432345 +0000 UTC m=+0.111778174 container create f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T00:36:05.048 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:04 smithi016 podman[31161]: 2024-09-21 00:36:04.68298705 +0000 UTC m=+0.016332890 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:36:05.048 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:04 smithi016 podman[31161]: 2024-09-21 00:36:04.964051653 +0000 UTC m=+0.297397491 container init f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:36:05.048 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:04 smithi016 podman[31161]: 2024-09-21 00:36:04.966869018 +0000 UTC m=+0.300214857 container start f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T00:36:05.048 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:05 smithi016 bash[31161]: f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc 2024-09-21T00:36:05.062 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:36:05.063 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-21T00:36:05.070 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:36:05.070 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:36:05.070 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-21T00:36:05.070 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:36:05.079 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:36:05.079 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr to start... 2024-09-21T00:36:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr... 2024-09-21T00:36:05.471 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:05 smithi016 systemd[1]: Started Ceph mgr.x for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:36:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:05 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1528783066' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:36:06.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:36:06.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:36:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:35:57:524567+0000", 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:35:57.525339+0000", 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:06.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:06.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:36:06.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:06.284 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (1/15)... 2024-09-21T00:36:09.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:08 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2204573463' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:36:09.303 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:36:09.304 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:36:09.305 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:36:09.306 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:35:57:524567+0000", 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:36:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:35:57.525339+0000", 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:36:09.308 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:09.309 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (2/15)... 2024-09-21T00:36:10.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: Activating manager daemon x 2024-09-21T00:36:10.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: mgrmap e2: x(active, starting, since 0.00394229s) 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: Manager daemon x is now available 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' 2024-09-21T00:36:10.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:10 smithi016 ceph-mon[30947]: from='mgr.14100 172.21.15.16:0/3766026113' entity='mgr.x' 2024-09-21T00:36:12.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:12 smithi016 ceph-mon[30947]: mgrmap e3: x(active, since 1.00827s) 2024-09-21T00:36:12.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:12 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1458916985' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:36:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:36:12.559 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:36:12.560 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:35:57:524567+0000", 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:36:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:35:57.525339+0000", 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:12.562 INFO:teuthology.orchestra.run.smithi016.stdout:mgr is available 2024-09-21T00:36:13.497 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:13 smithi016 ceph-mon[30947]: mgrmap e4: x(active, since 2s) 2024-09-21T00:36:13.497 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/520220183' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:36:13.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-21T00:36:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling cephadm module... 2024-09-21T00:36:14.845 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:14 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/357780576' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T00:36:14.845 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:14 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ignoring --setuser ceph since I am not root 2024-09-21T00:36:14.846 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:14 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ignoring --setgroup ceph since I am not root 2024-09-21T00:36:15.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:15 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/357780576' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T00:36:15.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:15 smithi016 ceph-mon[30947]: mgrmap e5: x(active, since 4s) 2024-09-21T00:36:16.497 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:16.497 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T00:36:16.497 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:36:16.497 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:36:16.497 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:36:16.498 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:16.498 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-09-21T00:36:16.498 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 5... 2024-09-21T00:36:16.805 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:16 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2174263325' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:36:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: Active manager daemon x restarted 2024-09-21T00:36:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: Activating manager daemon x 2024-09-21T00:36:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: mgrmap e6: x(active, starting, since 0.00366867s) 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:36:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:19 smithi016 ceph-mon[30947]: Manager daemon x is now available 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 5 is available 2024-09-21T00:36:21.419 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying orchestrator module is enabled... 2024-09-21T00:36:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:21 smithi016 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:36:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:21 smithi016 ceph-mon[30947]: mgrmap e7: x(active, since 1.0064s) 2024-09-21T00:36:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:21 smithi016 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:36:23.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:23.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:23.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: Found migration_current of "None". Setting to last migration. 2024-09-21T00:36:23.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:36:23.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2856503007' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T00:36:23.448 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:36:23.184+0000 7f58bedaf640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:36:23] ENGINE Error in HTTPServer.serve 2024-09-21T00:36:23.448 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: Traceback (most recent call last): 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._connections.run(self.expiration_interval) 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._run(expiration_interval) 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: s = self.context.wrap_socket( 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: return self.sslsocket_class._create( 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:36:23.449 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self.do_handshake() 2024-09-21T00:36:23.450 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:36:23.450 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._sslobj.do_handshake() 2024-09-21T00:36:23.450 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:36:23.450 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:36:23.450 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T00:36:23.450 INFO:teuthology.orchestra.run.smithi016.stdout:Setting orchestrator backend to cephadm... 2024-09-21T00:36:24.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2856503007' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: mgrmap e8: x(active, since 3s) 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:22] ENGINE Bus STARTING 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:23] ENGINE Serving on http://172.21.15.16:8765 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:23] ENGINE Serving on https://172.21.15.16:7150 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:23] ENGINE Bus STARTED 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:23 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:23] ENGINE Error in HTTPServer.serve 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:36:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._run(expiration_interval) 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: s = self.context.wrap_socket( 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.sslsocket_class._create( 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.do_handshake() 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._sslobj.do_handshake() 2024-09-21T00:36:24.011 INFO:journalctl@ceph.mon.a.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:36:25.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:24 smithi016 ceph-mon[30947]: mgrmap e9: x(active, since 4s) 2024-09-21T00:36:25.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:24 smithi016 ceph-mon[30947]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:25.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:24 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:25.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:24 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T00:36:25.755 INFO:teuthology.orchestra.run.smithi016.stdout:Generating ssh key... 2024-09-21T00:36:26.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:25 smithi016 ceph-mon[30947]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:26.851 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: Generating public/private rsa key pair. 2024-09-21T00:36:26.851 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: Your identification has been saved in /tmp/tmps57ccoav/key 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: Your public key has been saved in /tmp/tmps57ccoav/key.pub 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: The key fingerprint is: 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: SHA256:/A2S/qzZw4Qzh1n6nYmbtSmyhii2GUunvRfWbnnFB8w ceph-49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: The key's randomart image is: 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: +---[RSA 3072]----+ 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | o | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | . .. E | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | .S*.. . | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | o.Ooooo . | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | o .o +.O.+o+ | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | .oB. o *=Bo+o | 2024-09-21T00:36:26.852 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: | .=ooo o+=*+o | 2024-09-21T00:36:26.853 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: +----[SHA256]-----+ 2024-09-21T00:36:27.714 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:27 smithi016 ceph-mon[30947]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:27.714 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:27 smithi016 ceph-mon[30947]: Generating ssh key... 2024-09-21T00:36:27.714 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:27 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:27.715 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:27 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:28.269 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:28.269 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:36:28.270 INFO:teuthology.orchestra.run.smithi016.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T00:36:28.276 INFO:teuthology.orchestra.run.smithi016.stdout:Adding host smithi016... 2024-09-21T00:36:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:28 smithi016 ceph-mon[30947]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:29.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:29 smithi016 ceph-mon[30947]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "addr": "172.21.15.16", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:30.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:30 smithi016 ceph-mon[30947]: Deploying cephadm binary to smithi016 2024-09-21T00:36:33.386 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Added host 'smithi016' with addr '172.21.15.16' 2024-09-21T00:36:33.386 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying unmanaged mon service... 2024-09-21T00:36:34.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:33 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:34.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:33 smithi016 ceph-mon[30947]: Added host smithi016 2024-09-21T00:36:34.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:33 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:34.939 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T00:36:34.939 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying unmanaged mgr service... 2024-09-21T00:36:35.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:35 smithi016 ceph-mon[30947]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:35.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:35 smithi016 ceph-mon[30947]: Saving service mon spec with placement count:5 2024-09-21T00:36:35.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:35 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:36.472 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T00:36:36.814 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:36 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:36.815 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:36 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:36.815 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:36 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:37.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:37 smithi016 ceph-mon[30947]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:37.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:37 smithi016 ceph-mon[30947]: Saving service mgr spec with placement count:2 2024-09-21T00:36:37.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:37 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/606012848' entity='client.admin' 2024-09-21T00:36:39.347 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling the dashboard module... 2024-09-21T00:36:39.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:39 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:39.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:39 smithi016 ceph-mon[30947]: from='mgr.14118 172.21.15.16:0/2847986714' entity='mgr.x' 2024-09-21T00:36:39.454 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:39 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1751150013' entity='client.admin' 2024-09-21T00:36:41.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:40 smithi016 ceph-mon[30947]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:36:41.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:40 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1379918718' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T00:36:41.260 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ignoring --setuser ceph since I am not root 2024-09-21T00:36:41.260 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ignoring --setgroup ceph since I am not root 2024-09-21T00:36:42.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:41 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1379918718' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T00:36:42.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:41 smithi016 ceph-mon[30947]: mgrmap e10: x(active, since 21s) 2024-09-21T00:36:42.735 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:42.736 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T00:36:42.736 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:36:42.736 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:36:42.736 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:36:42.737 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:42.737 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-09-21T00:36:42.737 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 10... 2024-09-21T00:36:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:42 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3304594198' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:36:46.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: Active manager daemon x restarted 2024-09-21T00:36:46.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: Activating manager daemon x 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: mgrmap e11: x(active, starting, since 0.00391799s) 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:36:46.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:46 smithi016 ceph-mon[30947]: Manager daemon x is now available 2024-09-21T00:36:47.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:36:47.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:36:47.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:36:47.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:47 smithi016 ceph-mon[30947]: mgrmap e12: x(active, since 1.007s) 2024-09-21T00:36:48.039 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:36:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T00:36:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:36:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:36:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 10 is available 2024-09-21T00:36:48.040 INFO:teuthology.orchestra.run.smithi016.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-mon[30947]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-mon[30947]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:36:48.387+0000 7f655489f640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:36:48] ENGINE Error in HTTPServer.serve 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: Traceback (most recent call last): 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:36:48.482 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._connections.run(self.expiration_interval) 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._run(expiration_interval) 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: s = self.context.wrap_socket( 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: return self.sslsocket_class._create( 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self.do_handshake() 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:36:48.483 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: self._sslobj.do_handshake() 2024-09-21T00:36:48.484 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:36:48.484 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:36:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:36:49.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: mgrmap e13: x(active, since 2s) 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:48] ENGINE Bus STARTING 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:48] ENGINE Serving on https://172.21.15.16:7150 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:48] ENGINE Error in HTTPServer.serve 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._run(expiration_interval) 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:36:49.510 INFO:journalctl@ceph.mon.a.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: s = self.context.wrap_socket( 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.sslsocket_class._create( 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.do_handshake() 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._sslobj.do_handshake() 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:48] ENGINE Serving on http://172.21.15.16:8765 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: [21/Sep/2024:00:36:48] ENGINE Bus STARTED 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:49.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:36:51.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:50 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:36:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUfRHx9bNE7QVadE3VGMxGElhWnVUwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAwMzY1MFoXDTM0\nMDkyMjAwMzY1MFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjE2MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAxdt8qaKqdpPf0Yft7OQTIVojhfgjz1BsLyk3\n80xNxZBapp/vgt9Gn4w+IUG9DRcRkSOGHdp+6YcEO9AVuNCbIC9TmV5Q0cfVz/om\nIjcIGSA/VQEBNIDGtTxPcDIOgNOjkFmxcjuZK2QZK07Nbg+UZtRgDp4aIWr8dBoW\nsmq2Vi7EyH7tnkSbSTd/zTs4Xew0NmZnyrNYOHjjsi2sCqG2wMTljKvu8HIDcryw\nQOZOyTgWf2gmqZwg07WGLNkzGjo6mL7QXyxHCKmhHXTJxmHjNNuQp9f15R7V1JID\ny7BG3woYwnbvo43wRR3SF4rMQ80anV+1sijIS7vSGKoI7NAZC+GUjzH/yRj6XYq9\nGi46GjxS/w7m6pFgx0k5JARA7Gj5p1uMBpgfRZaq5c7LqXgF69nKVpsR0IT9kBie\n0UoP2aprNW7p2mihIQEMCeLkhPnN8BPygBQwcTmFZN1vZDMGQVkzLORdR0DQWks7\ngzgrfHzPTjchziauuHBwxTpzNhJAaf6/vHvTBqQF+egf3dK6SYu0xfxfJccA3Rcf\nSZktAnGFcanbI7LUq3qFxVDS/RwK03N13PZLZYxFSCCNTpJuzkTRxVym3v9LWxo9\nlRJn2SrwMjc/TZ8RGbdB/AZj9CH4jQZ+KjnzMNYO3wVTQ8E9sYO9kxs/3mWt6i5S\nz9EQ5/ECAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDE2ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPEDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBy\noLUjj3ZsLXyWRggjx9xlNd2smXVf2G1xsotqWWWHpyIi37gD8qberlZweweLIC7/\nrn214p0tPxuWdqguIykjSSC51tuhHYywKhcB7Ebp6G6xF9r08bMkxHIhq6d8syE4\nZktnFDk+Waqo8flcGLmB/3Gk5QfeK+cYb82ENdH7nphsNd5pCoZY083YAr56z1bS\nqGeOlFMuHoX+nnZNPiNWzlx76Q3KCv3B2fWtXffpb9ImS0pm+f0SH/9zSYD6kEik\noydTtLy5jL3fRzrY5heYRIZ2gSVpX+eZYlDYPJ2bMQzsJuArYog9IUgoSaLoFbXc\nNKHkKB7iu3rJkmiSJ98yM8UBFC/mfTtK6qpYP4k04tqdTupSctCPg5h4H1QGjvBy\nRwzTmLRVuOPJnF3lm4QYL6SVmqiPWObW+zXc7bm/8SB4fdyum4VbSdONSJXWRUbI\nKN4kWoc/eG5/8EWmF3bGBOYWjIM8GiGtCIvMhsQWJQWDvEfSOoXFibsVa6aslA3P\nIeagkmIT/eV/CUL0SwotkFY0ePFOY+ulFyS2bzx31mr5Np/Z1KssiK//r3RKOTX0\nPcCNusOtaMmFk9JY7OYVKd7/Azy37Qpc5NYyEopGQkq6tIYyKE+gNcP23R3QgcgL\n2bErL7grX7KmYIaoOL6UK5C9aaZrbuJsNDuKM65ArQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKgIBAAKCAgEAxdt8qaKqdpPf0Yft7OQTIVojhfgjz1BsLyk380xNxZBapp/v\ngt9Gn4w+IUG9DRcRkSOGHdp+6YcEO9AVuNCbIC9TmV5Q0cfVz/omIjcIGSA/VQEB\nNIDGtTxPcDIOgNOjkFmxcjuZK2QZK07Nbg+UZtRgDp4aIWr8dBoWsmq2Vi7EyH7t\nnkSbSTd/zTs4Xew0NmZnyrNYOHjjsi2sCqG2wMTljKvu8HIDcrywQOZOyTgWf2gm\nqZwg07WGLNkzGjo6mL7QXyxHCKmhHXTJxmHjNNuQp9f15R7V1JIDy7BG3woYwnbv\no43wRR3SF4rMQ80anV+1sijIS7vSGKoI7NAZC+GUjzH/yRj6XYq9Gi46GjxS/w7m\n6pFgx0k5JARA7Gj5p1uMBpgfRZaq5c7LqXgF69nKVpsR0IT9kBie0UoP2aprNW7p\n2mihIQEMCeLkhPnN8BPygBQwcTmFZN1vZDMGQVkzLORdR0DQWks7gzgrfHzPTjch\nziauuHBwxTpzNhJAaf6/vHvTBqQF+egf3dK6SYu0xfxfJccA3RcfSZktAnGFcanb\nI7LUq3qFxVDS/RwK03N13PZLZYxFSCCNTpJuzkTRxVym3v9LWxo9lRJn2SrwMjc/\nTZ8RGbdB/AZj9CH4jQZ+KjnzMNYO3wVTQ8E9sYO9kxs/3mWt6i5Sz9EQ5/ECAwEA\nAQKCAgAhRQL1U1Dul3bvOLgdOUyuMwX+JPeAiLloRLoPwyjgq6FSm1oe24R4l5Bq\n7y7m4JYnnZ2Tr4XfpsBjfl3oscsj4lFgXKeiXsPpMNrwrehCsVV06bJWLcE8AGQr\nLX+a0fuS7kIUP0lGLpK84YdRlnURxWxRiOxD6kWBEFH4tlDqtPqJ7C3wiwDBkv9+\ndxLHWEx/SUDyqK2Q8WL4Nw3Sy9Z7G6Ctwstuyv0hcfEBOLjOxQujaNP3eTVb5A4n\nxG3/XwMzZAKNvlhDcKKS3WyAWz1lSfZNAtdqK4ExOUxCF+YS4xO+v1kUW22ncZg+\nNSybygVLqShYSNtFQNPXKeBOUb+kH9q99UXfs/GBuG8l2B+81dU1ur/d1mZ5EQdW\ndY/ePooKtTY4eI6U9U59l8cvK6VUwPbafyu0uJo4kq1yJlWoQnihiR8ATzqT68Co\nzfQ//hwV5PC2Nr9LaZslhtA1pPm3Vn51hGy2wNLdMBuLK6ldp/V2MHDeBbpNTopR\nCfXfa/fYXQeqfvJMHKv2LTLBKTh7aalgKd31e2EiYMEaUFVeETTgt99JOfbHG5dI\nGmZcga2HdBH77nd1d3iFp81UonO5w93XUa/DZiTa1TpJqQksGpEDrHN5LiPUDnLk\njlSzSPliOKP7clXLE4iZtTGqfJL4L4uqls+UcOGes14iMM81QQKCAQEA9KUjRwJh\npfb1do+DX+HWydAtCedSxtcoT31lVtf+fx/oXfz2FyDCwn9s85rFSLdHwlt9q6pD\nrYdHYZ8Q3rZZQR0fnXU2H/1JlfsEWys3l6CcjvYCaYGtgVNtrmv1qkkrg/xfpLVp\nMFV2Oq4vc7PYfYadFYR/zFvTUFgMEYE8Diq6dQqJ8rOqqRuNGh/SUjc20g8qqG9r\nGves5BtjgmYCaeLT9WhFc2Uso/gQzdyz0CymLkHwhEnaG14iZiDBtBvvT+ncgubj\no55ixHZfR6348Q0r2vKBDcKTXwE2T2wJEwzSo2odwJarHVMriabrJ0aKV2c0KeH2\nuprdV56sODBn7QKCAQEAzwprc/XymqmyvjSBW6Rv66I8+UDPfd6oL7YucQypj1aC\n4yW+qwRUdpw2RXnEPy9o8JnKNNvkFpSkaG7d+T71ZakOQDTFZ7OocEGzI/574fFk\nOLrQkNC5SpSrOItF5lNs/SD2/x22KkZX3osFXBqAkCt26v+PbktkCYZ5UO1MZRy9\ndLTt/dBlwsoFomXs7maICSt3A1LkXOYF4DvcBSEr7A/Y+L8J5F81j4FyT+QBj0gs\nrPaYVypukTGNPFo8CAmM6oH+O83NUUMzwbo6FP9yrVzi7FlOP8pugPosvJuEJ59d\nawS27pmh2JzqQ+9B4F3Qayf0BmjjGrf/EDP2pcK3lQKCAQEAiRtXpv89rJ64OIb7\nsKvIDXifFTLQYGHK1KnJNp98oNBIEQyo+pNAs3JopCn0MOmOzO0rhB67KTBsn9he\nwwJdCTICOuOqvsjcCbMRYOrakB7SPwi+l1S24YjZKmyU1KeHPMQe8hc9aXor9X0T\nWPvM86SSurF0UhqQVjHSKalM9/+YWenbH+rzVSz8qkx1OeB518XqOVWgKA/wlDKJ\nVVZIOgGGmr2iVqa4Gvj2qfjryVqMk9YernUZSEc8bhIjnQYe26GMFMzDfTpRzhst\nEOX+Y1HnZyCLlSOcJh1uy5oXh9ai4jShkgKeyaOH/fBPT8an144eXO6nsTMDo4xo\npmDyjQKCAQEAusZZnWj5DVGdsD1JnVTAqr/XZbxz8scUzsX5K38Sz/5pYWVBlqH3\nWHEf/JkW0zF/5921Lu5X248IqjWqBhon4ygZdQ6mLyFCCNMcOpJvS6sqkIrncFz7\nay6nMAFkc547Kje82vUAyy5eQqMDmM1HwceUJfeaexOEEZvAgaMxUd4Vg91c/aYs\nxwbdAl4U2hShEDSnztXOsYfJMTqPCAmex/yb7frZf63scaODblLwnUOtGfP0Bl5/\nFHixQwrcMRv8henzYhwM5wxK+q93ik3QNFkhVbpS/vUtrykBhrx9AgmgitTb+m+a\nNAGKzPJgaXn4dVK7r7SbfBUVApb+IReB6QKCAQEAsKGzDfLr3cvSM2AjAO72+7C+\nAcop0LhBI8UNG0jwfh32nrV4fqYvcsaJAdOX6MjJehaRk/uNQ/CZoUaB+74KHeb1\nKIBYO5BIzoEgSV7UUYWQUXf2Sx7rqIshlEWK5psDTx1g3T2iiDxSUWgmQ1Kv0yZU\ngOx54FHCnK3YIey48h7Djqf9FJ5PnZwHrYDZ82u73h1R96UITjnZeJ0FgON1rmq1\nGxxXfS4PNrw/y/XlBzmkzkT3l3jAsAUoE16xpTiF7yXOJq+dHyXAM96T5YCGhMXu\nutmyZSUK+PWUqq7lf8RBhZIjowq9O6Ez+rLwHn48+Fp90/S42sPrxGN1le+Hrw==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T00:36:52.628 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T00:36:53.005 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:52 smithi016 ceph-mon[30947]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:53.005 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:52 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:36:53.809 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T00:36:53.810 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial admin user... 2024-09-21T00:36:54.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:54 smithi016 ceph-mon[30947]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:54.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:54 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:36:55.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$TnUN8MVw57zEi/BlduhjCe6TunCN2H93Alkc.b/s30DRCbzVY2o1m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726879014, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T00:36:55.233 INFO:teuthology.orchestra.run.smithi016.stdout:Fetching dashboard port number... 2024-09-21T00:36:56.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:55 smithi016 ceph-mon[30947]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:56.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:36:56.363 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T00:36:56.374 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:36:56.374 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-21T00:36:56.382 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:36:56.382 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-21T00:36:56.382 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-21T00:36:56.382 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph Dashboard is now available at: 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: URL: https://smithi016.front.sepia.ceph.com:8443/ 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: User: admin 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: Password: ht1g7e99q6 2024-09-21T00:36:56.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:56.385 INFO:teuthology.orchestra.run.smithi016.stdout:Saving cluster configuration to /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config directory 2024-09-21T00:36:56.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:56 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/667181946' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T00:36:57.637 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: ceph telemetry on 2024-09-21T00:36:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.639 INFO:teuthology.orchestra.run.smithi016.stdout:For more information see: 2024-09-21T00:36:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T00:36:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:36:57.639 INFO:teuthology.orchestra.run.smithi016.stdout:Bootstrap complete. 2024-09-21T00:36:57.679 INFO:tasks.cephadm:Fetching config... 2024-09-21T00:36:57.679 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:36:57.679 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T00:36:57.696 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T00:36:57.696 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:36:57.696 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T00:36:57.753 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T00:36:57.753 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:36:57.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T00:36:57.818 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T00:36:57.818 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:36:57.819 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T00:36:57.875 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T00:36:57.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:36:57.950 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:57.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:36:58.004 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:58.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:36:58.058 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfOy+R6kg9CMYi6OCzro83/QcjPKmWDAR67UW0zQJucBHU7U+GN+gGlzXiabUGiBDwHyLM6216Xayme3DNPjJl8SqMuiJxMecEC89OuO0clKHmRKFowN4fmQTO5spHZfQ+z3hxQ3suBTl25Cbn3PDXfIKTcj/8Fe0OJ+HY6zjuOGXbVK58UEWFG4XN5MLOrDxyD8cGXny/nR92r09xcTGpHZpHHr+X3wk1MWiMFnhnZ1tCqefxjSURC0oKule0KfX/WZ37+XKDHBxH641C4bfyAyM2AFdgjhkhTIN+KLfhgwCT2hMEDjBBeL1PArpgsfhRYaxaYD5ka6MBLC1dcck/o6q5R5DROXjqldcR5PDKk/1ii3LpGtR/BfxfVvbLzy0oE8ZPtywYmIq3ywK+xKKlpzqc2HTFaloMPLyJjFWcbpbOznhi5XBIn9qZLXjDsy2bkDzmFC7SlYpV63h72GNSq4B4f+nVivFjqKje4C/IMdpe5bon5A8HRumEO3pOeX8= ceph-49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:36:58.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T00:36:58.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:36:58 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/402157912' entity='client.admin' 2024-09-21T00:36:58.326 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:00.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:00 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1672339063' entity='client.admin' 2024-09-21T00:37:00.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:00 smithi016 ceph-mon[30947]: mgrmap e14: x(active, since 12s) 2024-09-21T00:37:00.598 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T00:37:00.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T00:37:01.290 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"} : dispatch 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:02.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:02.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:02.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:02.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:02.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:02.751 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi123 2024-09-21T00:37:02.752 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:37:02.752 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:37:02.770 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:37:02.770 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:02.829 INFO:tasks.cephadm:Adding host smithi123 to orchestrator... 2024-09-21T00:37:02.829 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch host add smithi123 2024-09-21T00:37:03.081 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: Updating smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: Updating smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:05.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:04 smithi016 ceph-mon[30947]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:05 smithi016 ceph-mon[30947]: Deploying cephadm binary to smithi123 2024-09-21T00:37:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi123' with addr '172.21.15.123' 2024-09-21T00:37:07.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:07 smithi016 ceph-mon[30947]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:08.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:37:08.327 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:08.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:08 smithi016 ceph-mon[30947]: Added host smithi123 2024-09-21T00:37:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:08.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:37:08.963 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}] 2024-09-21T00:37:09.525 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2024-09-21T00:37:09.526 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:37:09.526 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:37:09.542 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:37:09.542 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:09.598 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2024-09-21T00:37:09.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch host add smithi178 2024-09-21T00:37:09.853 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:09.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:09 smithi016 ceph-mon[30947]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:09.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:11.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:10 smithi016 ceph-mon[30947]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:37:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"} : dispatch 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T00:37:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: Deploying cephadm binary to smithi178 2024-09-21T00:37:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:13.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:37:13.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:13.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:13.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:12 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:14.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:13 smithi016 ceph-mon[30947]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:14.269 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi178' with addr '172.21.15.178' 2024-09-21T00:37:14.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:37:15.191 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: Added host smithi178 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:15.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:15 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:15.835 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:37:15.835 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2024-09-21T00:37:16.412 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T00:37:16.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T00:37:16.664 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:16.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:16 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:16.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:16 smithi016 ceph-mon[30947]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:37:17.587 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-09-21T00:37:17.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:17 smithi016 ceph-mon[30947]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:17.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1455306703' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:37:18.198 INFO:tasks.cephadm:Adding mon.a on smithi016 2024-09-21T00:37:18.198 INFO:tasks.cephadm:Adding mon.b on smithi123 2024-09-21T00:37:18.198 INFO:tasks.cephadm:Adding mon.c on smithi178 2024-09-21T00:37:18.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c' 2024-09-21T00:37:18.454 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:37:18.500 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:37:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1455306703' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:37:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"} : dispatch 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:19.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:19.200 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mon update... 2024-09-21T00:37:19.746 DEBUG:teuthology.orchestra.run.smithi123:mon.b> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T00:37:19.751 DEBUG:teuthology.orchestra.run.smithi178:mon.c> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T00:37:19.753 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:37:19.754 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:20.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:20.783 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:21.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:20 smithi016 ceph-mon[30947]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:21.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:20 smithi016 ceph-mon[30947]: Saving service mon spec with placement smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c;count:3 2024-09-21T00:37:21.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:20 smithi016 ceph-mon[30947]: Deploying daemon mon.c on smithi178 2024-09-21T00:37:21.998 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:37:21.998 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":1,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","modified":"2024-09-21T00:35:52.710580Z","created":"2024-09-21T00:35:52.710580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:37:21.998 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 1 2024-09-21T00:37:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:21 smithi016 ceph-mon[30947]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:23.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/626963950' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:23.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 podman[34869]: 2024-09-21 00:37:23.41442908 +0000 UTC m=+0.016860135 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:37:23.850 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:37:23.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:37:24.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 podman[34869]: 2024-09-21 00:37:23.728553047 +0000 UTC m=+0.330984101 container init dd9b5a929fa8412f4003a53b24cd7cfe8c494fe10b4a8f319811a6155ba2a1c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T00:37:24.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 podman[34869]: 2024-09-21 00:37:23.731644778 +0000 UTC m=+0.334075832 container start dd9b5a929fa8412f4003a53b24cd7cfe8c494fe10b4a8f319811a6155ba2a1c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pidfile_write: ignore empty --pid-file 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: load: jerasure load: lrc 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Git sha 0 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: DB SUMMARY 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: DB Session ID: P0FA05X0YFS7ITB7YO9O 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:37:24.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.env: 0x55c4e73c1d60 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.info_log: 0x55c4eda5d360 2024-09-21T00:37:24.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.statistics: (nil) 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.use_fsync: 0 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:37:24.041 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.db_log_dir: 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.wal_dir: 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:37:24.042 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.write_buffer_manager: 0x55c4eda61d60 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.unordered_write: 0 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:37:24.043 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.row_cache: None 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.wal_filter: None 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.wal_compression: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:37:24.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:37:24.045 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_open_files: -1 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Compression algorithms supported: 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kZSTD supported: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:37:24.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.merge_operator: 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_filter: None 2024-09-21T00:37:24.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4eda5cfa0) 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_type: 0 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_index_type: 0 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_shortening: 1 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: checksum: 4 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: no_block_cache: 0 2024-09-21T00:37:24.048 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache: 0x55c4e9a21610 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_options: 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: capacity : 536870912 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_shard_bits : 4 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: strict_capacity_limit : 0 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_compressed: (nil) 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: persistent_cache: (nil) 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size: 4096 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size_deviation: 10 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_restart_interval: 16 2024-09-21T00:37:24.049 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_block_restart_interval: 1 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: metadata_block_size: 4096 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: partition_filters: 0 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: use_delta_encoding: 1 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: filter_policy: bloomfilter 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: whole_key_filtering: 1 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: verify_compression: 0 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: format_version: 5 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_index_compression: 1 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_align: 0 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: max_auto_readahead_size: 262144 2024-09-21T00:37:24.050 INFO:journalctl@ceph.mon.c.smithi178.stdout: prepopulate_block_cache: 0 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression: NoCompression 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.num_levels: 7 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:37:24.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:37:24.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:37:24.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:37:24.054 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:37:24.055 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.ttl: 2592000 2024-09-21T00:37:24.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T00:37:24.057 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d4579ab3-e660-4ae5-947a-bc716ed48d51 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879043769012, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879043769428, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879043, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d4579ab3-e660-4ae5-947a-bc716ed48d51", "db_session_id": "P0FA05X0YFS7ITB7YO9O", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879043769526, "job": 1, "event": "recovery_finished"} 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c4eda80a80 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: DB pointer 0x55c4ee826000 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** DB Stats ** 2024-09-21T00:37:24.058 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.059 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:37:24.060 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache BinnedLRUCache@0x55c4e9a21610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: using public_addr v2:172.21.15.178:0/0 -> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: starting mon.c rank -1 at public addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] at bind addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(???) e0 preinit fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: e1 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: btime 2024-09-21T00:35:57:524567+0000 2024-09-21T00:37:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout: legacy client fscid: -1 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout: No filesystems configured 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:37:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"} : dispatch 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Deploying cephadm binary to smithi178 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:24.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Added host smithi178 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:37:24.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1455306703' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1455306703' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"} : dispatch 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:24.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Saving service mon spec with placement smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c;count:3 2024-09-21T00:37:24.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: Deploying daemon mon.c on smithi178 2024-09-21T00:37:24.067 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:24.067 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/626963950' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:24.067 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 ceph-mon[34888]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T00:37:24.067 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 bash[34869]: dd9b5a929fa8412f4003a53b24cd7cfe8c494fe10b4a8f319811a6155ba2a1c3 2024-09-21T00:37:24.067 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:23 smithi178 systemd[1]: Started Ceph mon.c for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:37:24.105 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: mon.a calling monitor election 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: mon.c calling monitor election 2024-09-21T00:37:29.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: monmap epoch 2 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: last_changed 2024-09-21T00:37:23.797197+0000 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: election_strategy: 1 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: fsmap 2024-09-21T00:37:29.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: mgrmap e14: x(active, since 42s) 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: overall HEALTH_OK 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:29.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:37:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: mon.a calling monitor election 2024-09-21T00:37:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: mon.c calling monitor election 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: monmap epoch 2 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: last_changed 2024-09-21T00:37:23.797197+0000 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: min_mon_release 19 (squid) 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: election_strategy: 1 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: fsmap 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: mgrmap e14: x(active, since 42s) 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: overall HEALTH_OK 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:29.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:29.367 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:37:29.367 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","modified":"2024-09-21T00:37:23.797197Z","created":"2024-09-21T00:35:52.710580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:37:29.367 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2024-09-21T00:37:29.919 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:29 smithi178 ceph-mon[34888]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:29.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:29 smithi178 ceph-mon[34888]: Deploying daemon mon.b on smithi123 2024-09-21T00:37:29.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/2467224625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:29.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:30.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:29 smithi016 ceph-mon[30947]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:30.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:29 smithi016 ceph-mon[30947]: Deploying daemon mon.b on smithi123 2024-09-21T00:37:30.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/2467224625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:30.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:30.921 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:37:30.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:37:31.174 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:37:31.850 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:37:31.850 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","modified":"2024-09-21T00:37:23.797197Z","created":"2024-09-21T00:35:52.710580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:37:31.850 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2024-09-21T00:37:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:31 smithi016 ceph-mon[30947]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:31 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/400134677' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:31 smithi178 ceph-mon[34888]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:31 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/400134677' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:32.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:32 smithi123 systemd[1]: Started Ceph mon.b for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:37:33.437 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:37:33.437 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:37:33.688 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: mon.c calling monitor election 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: mon.a calling monitor election 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: monmap epoch 3 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: election_strategy: 1 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: fsmap 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:37.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: mgrmap e14: x(active, since 51s) 2024-09-21T00:37:37.955 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: overall HEALTH_OK 2024-09-21T00:37:37.955 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.955 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.955 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.955 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.991 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:37:37.992 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","modified":"2024-09-21T00:37:32.582941Z","created":"2024-09-21T00:35:52.710580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:37:37.992 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2024-09-21T00:37:37.992 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.992 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:37:37.992 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.992 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: mon.c calling monitor election 2024-09-21T00:37:37.992 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: mon.a calling monitor election 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: monmap epoch 3 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:37.993 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: min_mon_release 19 (squid) 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: election_strategy: 1 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: fsmap 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: mgrmap e14: x(active, since 51s) 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: overall HEALTH_OK 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:37.994 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:38.569 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T00:37:38.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T00:37:38.831 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:38.895 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:38.895 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:38 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/3537529930' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:38.895 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:38.952 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:38.952 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:38 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/3537529930' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:38.952 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:39.591 INFO:teuthology.orchestra.run.smithi016.stdout:# minimal ceph.conf for 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:39.591 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-09-21T00:37:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: mon_host = [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-21T00:37:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: mon.c calling monitor election 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: mon.a calling monitor election 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: monmap epoch 3 2024-09-21T00:37:40.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: min_mon_release 19 (squid) 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: election_strategy: 1 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: fsmap 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: mgrmap e14: x(active, since 51s) 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: overall HEALTH_OK 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:40.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:40.023 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:40.023 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:40.023 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:40.023 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/3537529930' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:37:40.023 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:40.223 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T00:37:40.224 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:37:40.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:37:40.251 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:37:40.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:40.318 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:37:40.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:37:40.347 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:37:40.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:40.413 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:37:40.413 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:37:40.442 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:37:40.442 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:37:40.510 INFO:tasks.cephadm:Adding mgr.x on smithi016 2024-09-21T00:37:40.510 INFO:tasks.cephadm:Adding mgr.y on smithi123 2024-09-21T00:37:40.510 INFO:tasks.cephadm:Adding mgr.z on smithi178 2024-09-21T00:37:40.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi016=x;smithi123=y;smithi178=z' 2024-09-21T00:37:40.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mon.b calling monitor election 2024-09-21T00:37:40.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-21T00:37:40.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Updating smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: Reconfiguring daemon mon.a on smithi016 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mon.b calling monitor election 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mon.c calling monitor election 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mon.a calling monitor election 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: monmap epoch 3 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:40.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: min_mon_release 19 (squid) 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: election_strategy: 1 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: fsmap 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: mgrmap e14: x(active, since 53s) 2024-09-21T00:37:40.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:40 smithi123 ceph-mon[34853]: overall HEALTH_OK 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mon.b calling monitor election 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Updating smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: Reconfiguring daemon mon.a on smithi016 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mon.b calling monitor election 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mon.c calling monitor election 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mon.a calling monitor election 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: monmap epoch 3 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: min_mon_release 19 (squid) 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: election_strategy: 1 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:40.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:40.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: fsmap 2024-09-21T00:37:40.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:40.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: mgrmap e14: x(active, since 53s) 2024-09-21T00:37:40.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:40 smithi178 ceph-mon[34888]: overall HEALTH_OK 2024-09-21T00:37:40.792 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mon.b calling monitor election 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Updating smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:37:41.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: Reconfiguring daemon mon.a on smithi016 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mon.b calling monitor election 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mon.c calling monitor election 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mon.a calling monitor election 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: monmap epoch 3 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: last_changed 2024-09-21T00:37:32.582941+0000 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: created 2024-09-21T00:35:52.710580+0000 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-21T00:37:41.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: election_strategy: 1 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: fsmap 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: mgrmap e14: x(active, since 53s) 2024-09-21T00:37:41.012 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:40 smithi016 ceph-mon[30947]: overall HEALTH_OK 2024-09-21T00:37:41.395 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:41.729 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:41.902 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:41.903 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:41.903 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.929 DEBUG:teuthology.orchestra.run.smithi123:mgr.y> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T00:37:41.931 DEBUG:teuthology.orchestra.run.smithi178:mgr.z> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T00:37:41.934 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T00:37:41.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T00:37:41.936 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T00:37:41.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T00:37:41.962 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:37:41.582+0000 7f65882d4640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T00:37:41.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:41.964 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T00:37:41.964 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T00:37:42.006 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T00:37:42.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T00:37:42.050 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T00:37:42.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T00:37:42.093 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T00:37:42.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T00:37:42.136 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T00:37:42.136 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T00:37:42.181 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T00:37:42.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T00:37:42.226 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T00:37:42.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T00:37:42.269 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T00:37:42.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T00:37:42.270 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:42.314 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T00:37:42.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T00:37:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:42.352 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T00:37:42.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T00:37:42.395 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T00:37:42.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T00:37:42.439 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T00:37:42.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T00:37:42.483 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T00:37:42.483 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T00:37:42.536 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T00:37:42.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T00:37:42.579 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T00:37:42.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T00:37:42.632 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T00:37:42.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T00:37:42.681 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T00:37:42.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: Reconfiguring daemon mon.b on smithi123 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi016=x;smithi123=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: Saving service mgr spec with placement smithi016=x;smithi123=y;smithi178=z;count:3 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:42.743 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:42.743 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:42.747 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T00:37:42.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: Reconfiguring daemon mon.b on smithi123 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi016=x;smithi123=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: Saving service mgr spec with placement smithi016=x;smithi123=y;smithi178=z;count:3 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:42.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:42.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:42.790 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T00:37:42.790 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T00:37:42.833 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T00:37:42.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T00:37:42.877 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T00:37:42.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: Reconfiguring daemon mon.b on smithi123 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi016=x;smithi123=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: Saving service mgr spec with placement smithi016=x;smithi123=y;smithi178=z;count:3 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.881 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:42.882 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:37:42.882 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:37:42.882 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:42.931 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T00:37:42.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T00:37:42.980 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T00:37:42.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T00:37:43.009 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:43.025 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T00:37:43.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T00:37:43.098 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T00:37:43.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi016') 2024-09-21T00:37:43.742 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:43 smithi178 ceph-mon[34888]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:43.742 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:43 smithi178 ceph-mon[34888]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:37:43.742 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:43 smithi178 ceph-mon[34888]: Reconfiguring daemon mon.c on smithi178 2024-09-21T00:37:43.742 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:43 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3089629604' entity='client.admin' 2024-09-21T00:37:43.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:43 smithi016 ceph-mon[30947]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:43.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:43 smithi016 ceph-mon[30947]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:37:43.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:43 smithi016 ceph-mon[30947]: Reconfiguring daemon mon.c on smithi178 2024-09-21T00:37:43.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:43 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3089629604' entity='client.admin' 2024-09-21T00:37:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:43 smithi123 ceph-mon[34853]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:43 smithi123 ceph-mon[34853]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:37:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:43 smithi123 ceph-mon[34853]: Reconfiguring daemon mon.c on smithi178 2024-09-21T00:37:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:43 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3089629604' entity='client.admin' 2024-09-21T00:37:44.615 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi016') 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:45.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:45.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3186441692' entity='client.admin' 2024-09-21T00:37:45.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:44 smithi178 ceph-mon[34888]: Deploying daemon mgr.z on smithi178 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c6803fb20 msgr2=0x7f4c68042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c6803fb20 0x7f4c68042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000bbe0 tx=0x7f4c7000b390 comp rx=0 tx=0).stop 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c80104070 msgr2=0x7f4c8019aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c80104070 0x7f4c8019aed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009dc0 tx=0x7f4c78003970 comp rx=0 tx=0).stop 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 shutdown_connections 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c6803fb20 0x7f4c68042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c80104070 0x7f4c8019aed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c801036d0 0x7f4c8019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:45.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 --2- 172.21.15.16:0/3634801694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c80102640 0x7f4c80199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:45.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.187+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 >> 172.21.15.16:0/3634801694 conn(0x7f4c800fdfb0 msgr2=0x7f4c800ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:45.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.188+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 shutdown_connections 2024-09-21T00:37:45.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:45.188+0000 7f4c86ed0640 1 -- 172.21.15.16:0/3634801694 wait complete. 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.192 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:45.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:45.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:45.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3186441692' entity='client.admin' 2024-09-21T00:37:45.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:44 smithi016 ceph-mon[30947]: Deploying daemon mgr.z on smithi178 2024-09-21T00:37:45.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3186441692' entity='client.admin' 2024-09-21T00:37:45.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:45.273 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:44 smithi123 ceph-mon[34853]: Deploying daemon mgr.z on smithi178 2024-09-21T00:37:45.516 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi016') 2024-09-21T00:37:45.773 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.774 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.785 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.797 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.801 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.824 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:46.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:45 smithi016 ceph-mon[30947]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:46.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:45 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3634801694' entity='client.admin' 2024-09-21T00:37:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:45 smithi123 ceph-mon[34853]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:45 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3634801694' entity='client.admin' 2024-09-21T00:37:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:45 smithi178 ceph-mon[34888]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:45 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3634801694' entity='client.admin' 2024-09-21T00:37:46.288 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:37:45 smithi178 systemd[1]: Started Ceph mgr.z for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:37:46.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 -- 172.21.15.16:0/2917022114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398103750 msgr2=0x7f1398103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 --2- 172.21.15.16:0/2917022114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398103750 0x7f1398103bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1388009900 tx=0x7f138802a480 comp rx=0 tx=0).stop 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 -- 172.21.15.16:0/2917022114 shutdown_connections 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 --2- 172.21.15.16:0/2917022114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398105180 0x7f139810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 --2- 172.21.15.16:0/2917022114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f1398104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 --2- 172.21.15.16:0/2917022114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398103750 0x7f1398103bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 -- 172.21.15.16:0/2917022114 >> 172.21.15.16:0/2917022114 conn(0x7f13980ff0c0 msgr2=0x7f1398101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 -- 172.21.15.16:0/2917022114 shutdown_connections 2024-09-21T00:37:46.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.766+0000 7f139e583640 1 -- 172.21.15.16:0/2917022114 wait complete. 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 Processor -- start 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 -- start start 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398103750 0x7f1398199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f139819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f139810f110 con 0x7f1398105180 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f139810ef90 con 0x7f13981047e0 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.767+0000 7f139e583640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f139810f290 con 0x7f1398103750 2024-09-21T00:37:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f1397fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398103750 0x7f1398199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55636/0 (socket says 172.21.15.16:55636) 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 -- 172.21.15.16:0/3791113983 learned_addr learned my addr 172.21.15.16:0/3791113983 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f13977fe640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f139819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 -- 172.21.15.16:0/3791113983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398103750 msgr2=0x7f1398199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398103750 0x7f1398199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 -- 172.21.15.16:0/3791113983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 msgr2=0x7f139819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f139819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 -- 172.21.15.16:0/3791113983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139819b820 con 0x7f1398105180 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f13977fe640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f139819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139cb20640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f139000eb10 tx=0x7f139000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390004b20 con 0x7f1398105180 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f1390004cc0 con 0x7f1398105180 2024-09-21T00:37:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139819bb10 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390010690 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.768+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13981a2210 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.769+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f1390010830 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.769+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1398103bc0 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.770+0000 7f13957fa640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 0x7f1380042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.770+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1390054970 con 0x7f1398105180 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.770+0000 7f1397fff640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 0x7f1380042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:46.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.770+0000 7f1397fff640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 0x7f1380042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1388009230 tx=0x7f13880058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:46.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.775+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1390016330 con 0x7f1398105180 2024-09-21T00:37:46.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.964+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f1398063fc0 con 0x7f1398105180 2024-09-21T00:37:46.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.968+0000 7f13957fa640 1 -- 172.21.15.16:0/3791113983 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v13)=0 v13) ==== 106+0+0 (secure 0 0 0) 0x7f139001b160 con 0x7f1398105180 2024-09-21T00:37:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.971+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 msgr2=0x7f1380042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.971+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 0x7f1380042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1388009230 tx=0x7f13880058d0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.971+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 msgr2=0x7f139819b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.971+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f139000eb10 tx=0x7f139000c2d0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 shutdown_connections 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f138003fb20 0x7f1380042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1398105180 0x7f139819b000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13981047e0 0x7f139819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 --2- 172.21.15.16:0/3791113983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1398103750 0x7f1398199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:46.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 >> 172.21.15.16:0/3791113983 conn(0x7f13980ff0c0 msgr2=0x7f1398107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:46.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 shutdown_connections 2024-09-21T00:37:46.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:46.972+0000 7f139e583640 1 -- 172.21.15.16:0/3791113983 wait complete. 2024-09-21T00:37:47.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: Deploying daemon mgr.y on smithi123 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:47 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3791113983' entity='client.admin' 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: Deploying daemon mgr.y on smithi123 2024-09-21T00:37:47.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:47.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:47 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3791113983' entity='client.admin' 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: Deploying daemon mgr.y on smithi123 2024-09-21T00:37:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:47.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:47 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3791113983' entity='client.admin' 2024-09-21T00:37:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 -- 172.21.15.16:0/2829670523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf81051b0 msgr2=0x7faaf810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 --2- 172.21.15.16:0/2829670523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf81051b0 0x7faaf810bb50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009ca0 tx=0x7faaf002a950 comp rx=0 tx=0).stop 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 -- 172.21.15.16:0/2829670523 shutdown_connections 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 --2- 172.21.15.16:0/2829670523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf81051b0 0x7faaf810bb50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 --2- 172.21.15.16:0/2829670523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8104810 0x7faaf8104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 --2- 172.21.15.16:0/2829670523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf8103780 0x7faaf8103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 -- 172.21.15.16:0/2829670523 >> 172.21.15.16:0/2829670523 conn(0x7faaf80ff0f0 msgr2=0x7faaf81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 -- 172.21.15.16:0/2829670523 shutdown_connections 2024-09-21T00:37:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.655+0000 7faafca6d640 1 -- 172.21.15.16:0/2829670523 wait complete. 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 Processor -- start 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 -- start start 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 0x7faaf8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf81051b0 0x7faaf8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810f150 con 0x7faaf8104810 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810efd0 con 0x7faaf8103780 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faafca6d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810f2d0 con 0x7faaf81051b0 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faaf659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faaf659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:54942/0 (socket says 172.21.15.16:54942) 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faaf5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 0x7faaf8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faaf659c640 1 -- 172.21.15.16:0/4135075628 learned_addr learned my addr 172.21.15.16:0/4135075628 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.656+0000 7faaf6d9d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf81051b0 0x7faaf8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 -- 172.21.15.16:0/4135075628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf81051b0 msgr2=0x7faaf8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf81051b0 0x7faaf8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 -- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 msgr2=0x7faaf8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 0x7faaf8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 -- 172.21.15.16:0/4135075628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf8076350 con 0x7faaf8103780 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf5d9b640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 0x7faaf8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faaf659c640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9f0 tx=0x7faae800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae800cd80 con 0x7faaf8103780 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7faae8005490 con 0x7faaf8103780 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81a3e70 con 0x7faaf8103780 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8010430 con 0x7faaf8103780 2024-09-21T00:37:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.657+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a4210 con 0x7faaf8103780 2024-09-21T00:37:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.658+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7faae80105d0 con 0x7faaf8103780 2024-09-21T00:37:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.658+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf810f910 con 0x7faaf8103780 2024-09-21T00:37:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.659+0000 7faae77fe640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 0x7faae0042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.659+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faae8054980 con 0x7faaf8103780 2024-09-21T00:37:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.659+0000 7faaf5d9b640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 0x7faae0042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.659+0000 7faaf5d9b640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 0x7faae0042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faaec009fc0 tx=0x7faaec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:47.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.664+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faae8016330 con 0x7faaf8103780 2024-09-21T00:37:47.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.857+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7faaf810a960 con 0x7faaf8103780 2024-09-21T00:37:47.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.862+0000 7faae77fe640 1 -- 172.21.15.16:0/4135075628 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v14)=0 v14) ==== 115+0+0 (secure 0 0 0) 0x7faae80108c0 con 0x7faaf8103780 2024-09-21T00:37:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 msgr2=0x7faae0042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 0x7faae0042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faaec009fc0 tx=0x7faaec005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 msgr2=0x7faaf8076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9f0 tx=0x7faae800edf0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 shutdown_connections 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faae003fb20 0x7faae0042030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaf81051b0 0x7faaf8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaf8104810 0x7faaf8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 --2- 172.21.15.16:0/4135075628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaf8103780 0x7faaf8076e40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 >> 172.21.15.16:0/4135075628 conn(0x7faaf80ff0f0 msgr2=0x7faaf8107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 shutdown_connections 2024-09-21T00:37:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:47.864+0000 7faafca6d640 1 -- 172.21.15.16:0/4135075628 wait complete. 2024-09-21T00:37:47.953 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:47 smithi123 systemd[1]: Starting Ceph mgr.y for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:37:48.223 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:47 smithi123 podman[35658]: 2024-09-21 00:37:47.854347696 +0000 UTC m=+0.015442339 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:37:48.223 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:47 smithi123 podman[35658]: 2024-09-21 00:37:47.982712326 +0000 UTC m=+0.143806964 container create be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T00:37:48.223 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:48 smithi123 podman[35658]: 2024-09-21 00:37:48.184863673 +0000 UTC m=+0.345958307 container init be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T00:37:48.223 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:48 smithi123 podman[35658]: 2024-09-21 00:37:48.1874477 +0000 UTC m=+0.348542345 container start be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:37:48.223 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mgr[35678]: -- 172.21.15.123:0/3144224729 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55809c6dd0e0 con 0x55809c6fba80 2024-09-21T00:37:48.520 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:48 smithi123 bash[35658]: be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 2024-09-21T00:37:48.520 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:37:48 smithi123 systemd[1]: Started Ceph mgr.y for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:37:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='client.? ' entity='client.admin' 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1723711268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 msgr2=0x7f3cf8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1723711268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf8104bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009900 tx=0x7f3ce002a480 comp rx=0 tx=0).stop 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1723711268 shutdown_connections 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1723711268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8105180 0x7f3cf810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1723711268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf8104bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1723711268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8103750 0x7f3cf8103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1723711268 >> 172.21.15.16:0/1723711268 conn(0x7f3cf80ff0c0 msgr2=0x7f3cf8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1723711268 shutdown_connections 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.799+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1723711268 wait complete. 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 Processor -- start 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 -- start start 2024-09-21T00:37:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 0x7f3cf8199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 0x7f3cf819b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810f170 con 0x7f3cf81047e0 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810eff0 con 0x7f3cf8105180 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfe6f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf810f2f0 con 0x7f3cf8103750 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3ceffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3ceffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55684/0 (socket says 172.21.15.16:55684) 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3ceffff640 1 -- 172.21.15.16:0/1587230962 learned_addr learned my addr 172.21.15.16:0/1587230962 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cf7fff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 0x7f3cf8199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.800+0000 7f3cfcc95640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 0x7f3cf819b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 -- 172.21.15.16:0/1587230962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 msgr2=0x7f3cf8199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 0x7f3cf8199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 -- 172.21.15.16:0/1587230962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 msgr2=0x7f3cf819b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 0x7f3cf819b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 -- 172.21.15.16:0/1587230962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf819b830 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cf7fff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 0x7f3cf8199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cfcc95640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 0x7f3cf819b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3ceffff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ce002aa70 tx=0x7f3ce0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce003f070 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f3ce0031b20 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf819bac0 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0035030 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.801+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf81a2050 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.802+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf8103bc0 con 0x7f3cf81047e0 2024-09-21T00:37:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.802+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f3ce0042070 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.802+0000 7f3cf5ffb640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 0x7f3ce4042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.802+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3ce0074cf0 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.803+0000 7f3cf7fff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 0x7f3ce4042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.803+0000 7f3cf7fff640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 0x7f3ce4042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009fc0 tx=0x7f3ce8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:48.808+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ce0079070 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.004+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3cf8063fc0 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.009+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f3ce004c350 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.010+0000 7f3cf5ffb640 1 -- 172.21.15.16:0/1587230962 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ce0031cd0 con 0x7f3cf81047e0 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.011+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 msgr2=0x7f3ce4042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 0x7f3ce4042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009fc0 tx=0x7f3ce8005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 msgr2=0x7f3cf819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ce002aa70 tx=0x7f3ce0003c10 comp rx=0 tx=0).stop 2024-09-21T00:37:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 shutdown_connections 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3ce403fb20 0x7f3ce4042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cf8105180 0x7f3cf819b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cf81047e0 0x7f3cf819a470 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 --2- 172.21.15.16:0/1587230962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cf8103750 0x7f3cf8199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 >> 172.21.15.16:0/1587230962 conn(0x7f3cf80ff0c0 msgr2=0x7f3cf8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 shutdown_connections 2024-09-21T00:37:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.012+0000 7f3cfe6f8640 1 -- 172.21.15.16:0/1587230962 wait complete. 2024-09-21T00:37:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='client.? ' entity='client.admin' 2024-09-21T00:37:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='client.? ' entity='client.admin' 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 -- 172.21.15.16:0/2471085005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 msgr2=0x7fb53410b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 --2- 172.21.15.16:0/2471085005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53410b0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb524009900 tx=0x7fb52402a410 comp rx=0 tx=0).stop 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 -- 172.21.15.16:0/2471085005 shutdown_connections 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 --2- 172.21.15.16:0/2471085005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53410b680 0x7fb53410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 --2- 172.21.15.16:0/2471085005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53410b0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 --2- 172.21.15.16:0/2471085005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53406b7b0 0x7fb534108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 -- 172.21.15.16:0/2471085005 >> 172.21.15.16:0/2471085005 conn(0x7fb5340fdfb0 msgr2=0x7fb534100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 -- 172.21.15.16:0/2471085005 shutdown_connections 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.732+0000 7fb53b378640 1 -- 172.21.15.16:0/2471085005 wait complete. 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 Processor -- start 2024-09-21T00:37:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 -- start start 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 0x7fb53419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53410b680 0x7fb53419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb534111480 con 0x7fb534108cd0 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb534111300 con 0x7fb53406b7b0 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb53b378640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb534111600 con 0x7fb53410b680 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb538913640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb538913640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55706/0 (socket says 172.21.15.16:55706) 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb538913640 1 -- 172.21.15.16:0/3904741767 learned_addr learned my addr 172.21.15.16:0/3904741767 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb539114640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 0x7fb53419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb539915640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53410b680 0x7fb53419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.733+0000 7fb538913640 1 -- 172.21.15.16:0/3904741767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53410b680 msgr2=0x7fb53419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb538913640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53410b680 0x7fb53419d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb538913640 1 -- 172.21.15.16:0/3904741767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 msgr2=0x7fb53419c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb538913640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 0x7fb53419c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb538913640 1 -- 172.21.15.16:0/3904741767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53419dae0 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb539114640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 0x7fb53419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb538913640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb524031440 tx=0x7fb524003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52403f070 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb524031b80 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53419dd70 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5341a44d0 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.734+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524035030 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.735+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7fb524042070 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.735+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5340ffad0 con 0x7fb534108cd0 2024-09-21T00:37:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.735+0000 7fb52a7fc640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 0x7fb520042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.736+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb524074ea0 con 0x7fb534108cd0 2024-09-21T00:37:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.736+0000 7fb539114640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 0x7fb520042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.736+0000 7fb539114640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 0x7fb520042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb530009fc0 tx=0x7fb530005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.741+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb524031da0 con 0x7fb534108cd0 2024-09-21T00:37:49.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.946+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb53402e640 con 0x7fb534108cd0 2024-09-21T00:37:49.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.950+0000 7fb52a7fc640 1 -- 172.21.15.16:0/3904741767 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7fb524043e50 con 0x7fb534108cd0 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 msgr2=0x7fb520042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 0x7fb520042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb530009fc0 tx=0x7fb530005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 msgr2=0x7fb53419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb524031440 tx=0x7fb524003c10 comp rx=0 tx=0).stop 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 shutdown_connections 2024-09-21T00:37:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb52003fb20 0x7fb520042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb53410b680 0x7fb53419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb534108cd0 0x7fb53419c720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 --2- 172.21.15.16:0/3904741767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb53406b7b0 0x7fb53419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 >> 172.21.15.16:0/3904741767 conn(0x7fb5340fdfb0 msgr2=0x7fb534109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 shutdown_connections 2024-09-21T00:37:49.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.953+0000 7fb53b378640 1 -- 172.21.15.16:0/3904741767 wait complete. 2024-09-21T00:37:49.995 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1587230962' entity='client.admin' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:49.996 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:49 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1134860051' entity='client.admin' 2024-09-21T00:37:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1587230962' entity='client.admin' 2024-09-21T00:37:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:50.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:49 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1134860051' entity='client.admin' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1587230962' entity='client.admin' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:37:50.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:37:50.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:37:50.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:49 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1134860051' entity='client.admin' 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 -- 172.21.15.16:0/4251788754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6320106900 msgr2=0x7f6320108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 --2- 172.21.15.16:0/4251788754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6320106900 0x7f6320108d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6314009900 tx=0x7f631402a410 comp rx=0 tx=0).stop 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 -- 172.21.15.16:0/4251788754 shutdown_connections 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 --2- 172.21.15.16:0/4251788754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63201094a0 0x7f632010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 --2- 172.21.15.16:0/4251788754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6320106900 0x7f6320108d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 --2- 172.21.15.16:0/4251788754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f632006c660 0x7f63201063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.758+0000 7f6324a67640 1 -- 172.21.15.16:0/4251788754 >> 172.21.15.16:0/4251788754 conn(0x7f63200fdfe0 msgr2=0x7f6320100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.759+0000 7f6324a67640 1 -- 172.21.15.16:0/4251788754 shutdown_connections 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.759+0000 7f6324a67640 1 -- 172.21.15.16:0/4251788754 wait complete. 2024-09-21T00:37:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.759+0000 7f6324a67640 1 Processor -- start 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.759+0000 7f6324a67640 1 -- start start 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 0x7f632019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f632010f250 con 0x7f63201094a0 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f632010f0d0 con 0x7f6320106900 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f6324a67640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f632010f3d0 con 0x7f632006c660 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 0x7f632019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:47486/0 (socket says 172.21.15.16:47486) 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55740/0 (socket says 172.21.15.16:55740) 2024-09-21T00:37:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631e59c640 1 -- 172.21.15.16:0/604954127 learned_addr learned my addr 172.21.15.16:0/604954127 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 -- 172.21.15.16:0/604954127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 msgr2=0x7f6320199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 -- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 msgr2=0x7f632019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 -- 172.21.15.16:0/604954127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632019b910 con 0x7f6320106900 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631e59c640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631ed9d640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.760+0000 7f631dd9b640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 0x7f632019a550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6314006010 tx=0x7f6314004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.761+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631403f030 con 0x7f6320106900 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.761+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632019bba0 con 0x7f6320106900 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.761+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6314032e40 con 0x7f6320106900 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.761+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314035070 con 0x7f6320106900 2024-09-21T00:37:50.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.761+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201a2130 con 0x7f6320106900 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63200ffb00 con 0x7f6320106900 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f6314042030 con 0x7f6320106900 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f630f7fe640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 0x7f6308042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6314074b70 con 0x7f6320106900 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f631e59c640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 0x7f6308042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.762+0000 7f631e59c640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 0x7f6308042030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6310011550 tx=0x7f6310005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.771+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6314003d30 con 0x7f6320106900 2024-09-21T00:37:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- 172.21.15.16:0/2215224970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414105180 msgr2=0x7f841410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 --2- 172.21.15.16:0/2215224970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414105180 0x7f841410bb20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f840c009ca0 tx=0x7f840c02a950 comp rx=0 tx=0).stop 2024-09-21T00:37:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- 172.21.15.16:0/2215224970 shutdown_connections 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 --2- 172.21.15.16:0/2215224970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414105180 0x7f841410bb20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 --2- 172.21.15.16:0/2215224970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 0x7f8414104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 --2- 172.21.15.16:0/2215224970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414103750 0x7f8414103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- 172.21.15.16:0/2215224970 >> 172.21.15.16:0/2215224970 conn(0x7f84140ff0c0 msgr2=0x7f8414101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- 172.21.15.16:0/2215224970 shutdown_connections 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- 172.21.15.16:0/2215224970 wait complete. 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 Processor -- start 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.161+0000 7f841c288640 1 -- start start 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 0x7f841419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414105180 0x7f841419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f841410f260 con 0x7f8414103750 2024-09-21T00:37:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f841410f0e0 con 0x7f84141047e0 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f841410f3e0 con 0x7f8414105180 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55716/0 (socket says 172.21.15.16:55716) 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 -- 172.21.15.16:0/4084719116 learned_addr learned my addr 172.21.15.16:0/4084719116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f8419823640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 0x7f841419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a825640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414105180 0x7f841419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 -- 172.21.15.16:0/4084719116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414105180 msgr2=0x7f841419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414105180 0x7f841419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 -- 172.21.15.16:0/4084719116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 msgr2=0x7f841419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 0x7f841419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 -- 172.21.15.16:0/4084719116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841419b8a0 con 0x7f8414103750 2024-09-21T00:37:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841a024640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9f0 tx=0x7f841000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000cd80 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f84100054b0 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.162+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841419bb90 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.163+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410010430 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.163+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141a2290 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.163+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841410a930 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.164+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f84100105f0 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.164+0000 7f840b7fe640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 0x7f8400042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.164+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8410054990 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.164+0000 7f8419823640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 0x7f8400042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.164+0000 7f8419823640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 0x7f8400042030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8404005d00 tx=0x7f840400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.169+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8410005020 con 0x7f8414103750 2024-09-21T00:37:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.361+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f841402e640 con 0x7f8414103750 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.364+0000 7f840b7fe640 1 -- 172.21.15.16:0/4084719116 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f8410020e10 con 0x7f8414103750 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 msgr2=0x7f8400042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 0x7f8400042030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8404005d00 tx=0x7f840400b410 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 msgr2=0x7f8414199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9f0 tx=0x7f841000edf0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 shutdown_connections 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f840003fb20 0x7f8400042030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8414105180 0x7f841419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84141047e0 0x7f841419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 --2- 172.21.15.16:0/4084719116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8414103750 0x7f8414199ee0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 >> 172.21.15.16:0/4084719116 conn(0x7f84140ff0c0 msgr2=0x7f8414107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 shutdown_connections 2024-09-21T00:37:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.367+0000 7f841c288640 1 -- 172.21.15.16:0/4084719116 wait complete. 2024-09-21T00:37:50.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.963+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f632002e640 con 0x7f6320106900 2024-09-21T00:37:50.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.969+0000 7f630f7fe640 1 -- 172.21.15.16:0/604954127 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f631403bbb0 con 0x7f6320106900 2024-09-21T00:37:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 msgr2=0x7f6308042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 0x7f6308042030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6310011550 tx=0x7f6310005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 msgr2=0x7f632019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 0x7f632019a550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6314006010 tx=0x7f6314004270 comp rx=0 tx=0).stop 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 shutdown_connections 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f630803fb20 0x7f6308042030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63201094a0 0x7f632019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6320106900 0x7f632019a550 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 --2- 172.21.15.16:0/604954127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f632006c660 0x7f6320199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 >> 172.21.15.16:0/604954127 conn(0x7f63200fdfe0 msgr2=0x7f6320104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 shutdown_connections 2024-09-21T00:37:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:50.971+0000 7f6324a67640 1 -- 172.21.15.16:0/604954127 wait complete. 2024-09-21T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: Reconfiguring daemon mgr.x on smithi016 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3904741767' entity='client.admin' 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4084719116' entity='client.admin' 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: Standby manager daemon z started 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:37:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:50 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: Reconfiguring daemon mgr.x on smithi016 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3904741767' entity='client.admin' 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4084719116' entity='client.admin' 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: Standby manager daemon z started 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:37:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:50 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: Reconfiguring daemon mgr.x on smithi016 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3904741767' entity='client.admin' 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4084719116' entity='client.admin' 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: Standby manager daemon z started 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:37:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:50 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.178:0/1969952631' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 -- 172.21.15.16:0/3775531335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef441068d0 msgr2=0x7fef44108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 --2- 172.21.15.16:0/3775531335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef441068d0 0x7fef44108d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef38009900 tx=0x7fef3802a410 comp rx=0 tx=0).stop 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 -- 172.21.15.16:0/3775531335 shutdown_connections 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 --2- 172.21.15.16:0/3775531335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef44109470 0x7fef4410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 --2- 172.21.15.16:0/3775531335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef441068d0 0x7fef44108d30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 --2- 172.21.15.16:0/3775531335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef4406b980 0x7fef44106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 -- 172.21.15.16:0/3775531335 >> 172.21.15.16:0/3775531335 conn(0x7fef440fdfb0 msgr2=0x7fef44100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 -- 172.21.15.16:0/3775531335 shutdown_connections 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.555+0000 7fef48a93640 1 -- 172.21.15.16:0/3775531335 wait complete. 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 Processor -- start 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 -- start start 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef441068d0 0x7fef44102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 0x7fef441027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410f240 con 0x7fef4406b980 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410f0c0 con 0x7fef44109470 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef48a93640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410f3c0 con 0x7fef441068d0 2024-09-21T00:37:51.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef4259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef4259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55698/0 (socket says 172.21.15.16:55698) 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef4259c640 1 -- 172.21.15.16:0/1134860051 learned_addr learned my addr 172.21.15.16:0/1134860051 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef42d9d640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 0x7fef441027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.556+0000 7fef41d9b640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef441068d0 0x7fef44102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 -- 172.21.15.16:0/1134860051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef441068d0 msgr2=0x7fef44102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef441068d0 0x7fef44102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 -- 172.21.15.16:0/1134860051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 msgr2=0x7fef441027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 0x7fef441027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 -- 172.21.15.16:0/1134860051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef44102ed0 con 0x7fef4406b980 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef42d9d640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 0x7fef441027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef4259c640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef3400ea60 tx=0x7fef3400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3400cde0 con 0x7fef4406b980 2024-09-21T00:37:51.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fef340035f0 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef441a3f60 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34010690 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.557+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef441a4350 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.558+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef44106d20 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.559+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7fef34010830 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.559+0000 7fef337fe640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 0x7fef2c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.559+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fef34054760 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.559+0000 7fef41d9b640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 0x7fef2c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.560+0000 7fef41d9b640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 0x7fef2c042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef38000c00 tx=0x7fef38031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.564+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef34013190 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.763+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fef440ffad0 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.766+0000 7fef337fe640 1 -- 172.21.15.16:0/1134860051 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v16)=0 v16) ==== 125+0+0 (secure 0 0 0) 0x7fef340037a0 con 0x7fef4406b980 2024-09-21T00:37:51.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 msgr2=0x7fef2c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 0x7fef2c042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef38000c00 tx=0x7fef38031400 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 msgr2=0x7fef441039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef3400ea60 tx=0x7fef3400ef20 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 shutdown_connections 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fef2c03fb20 0x7fef2c042030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef44109470 0x7fef441027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef441068d0 0x7fef44102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 --2- 172.21.15.16:0/1134860051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef4406b980 0x7fef441039c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.769+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 >> 172.21.15.16:0/1134860051 conn(0x7fef440fdfb0 msgr2=0x7fef44104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.770+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 shutdown_connections 2024-09-21T00:37:51.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:49.770+0000 7fef48a93640 1 -- 172.21.15.16:0/1134860051 wait complete. 2024-09-21T00:37:52.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:51 smithi016 ceph-mon[30947]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:52.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:51 smithi016 ceph-mon[30947]: from='client.? ' entity='client.admin' 2024-09-21T00:37:52.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:51 smithi016 ceph-mon[30947]: mgrmap e15: x(active, since 65s), standbys: z 2024-09-21T00:37:52.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:37:52.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:51 smithi123 ceph-mon[34853]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:51 smithi123 ceph-mon[34853]: from='client.? ' entity='client.admin' 2024-09-21T00:37:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:51 smithi123 ceph-mon[34853]: mgrmap e15: x(active, since 65s), standbys: z 2024-09-21T00:37:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:37:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:51 smithi178 ceph-mon[34888]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:51 smithi178 ceph-mon[34888]: from='client.? ' entity='client.admin' 2024-09-21T00:37:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:51 smithi178 ceph-mon[34888]: mgrmap e15: x(active, since 65s), standbys: z 2024-09-21T00:37:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:37:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 -- 172.21.15.16:0/1028527723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac103750 msgr2=0x7f43ac103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 --2- 172.21.15.16:0/1028527723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac103750 0x7f43ac103bc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009900 tx=0x7f43a802a480 comp rx=0 tx=0).stop 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 -- 172.21.15.16:0/1028527723 shutdown_connections 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 --2- 172.21.15.16:0/1028527723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac105180 0x7f43ac10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 --2- 172.21.15.16:0/1028527723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 --2- 172.21.15.16:0/1028527723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac103750 0x7f43ac103bc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 -- 172.21.15.16:0/1028527723 >> 172.21.15.16:0/1028527723 conn(0x7f43ac0ff0c0 msgr2=0x7f43ac101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 -- 172.21.15.16:0/1028527723 shutdown_connections 2024-09-21T00:37:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 -- 172.21.15.16:0/1028527723 wait complete. 2024-09-21T00:37:53.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.429+0000 7f43b41b4640 1 Processor -- start 2024-09-21T00:37:53.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 -- start start 2024-09-21T00:37:53.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac103750 0x7f43ac076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10f230 con 0x7f43ac105180 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10f0b0 con 0x7f43ac1047e0 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b41b4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10f3b0 con 0x7f43ac103750 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b174f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55776/0 (socket says 172.21.15.16:55776) 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b174f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:55056/0 (socket says 172.21.15.16:55056) 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 -- 172.21.15.16:0/2030369301 learned_addr learned my addr 172.21.15.16:0/2030369301 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b1f50640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac103750 0x7f43ac076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 -- 172.21.15.16:0/2030369301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac103750 msgr2=0x7f43ac076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac103750 0x7f43ac076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 -- 172.21.15.16:0/2030369301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 msgr2=0x7f43ac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 -- 172.21.15.16:0/2030369301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac0762c0 con 0x7f43ac105180 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b174f640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.430+0000 7f43b2751640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a400cce0 tx=0x7f43a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.431+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a400f450 con 0x7f43ac105180 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.431+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f43a400fa80 con 0x7f43ac105180 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.431+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1a3f70 con 0x7f43ac105180 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.431+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4018ae0 con 0x7f43ac105180 2024-09-21T00:37:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.431+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1a4310 con 0x7f43ac105180 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.432+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac103bc0 con 0x7f43ac105180 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.433+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f43a400f5f0 con 0x7f43ac105180 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.433+0000 7f43a2ffd640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 0x7f439807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.433+0000 7f43b1f50640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 0x7f439807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.433+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f43a409d4d0 con 0x7f43ac105180 2024-09-21T00:37:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.434+0000 7f43b1f50640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 0x7f439807d4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43a8031440 tx=0x7f43a8009630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.438+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43a4014030 con 0x7f43ac105180 2024-09-21T00:37:53.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.632+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f43ac063fc0 con 0x7f43ac105180 2024-09-21T00:37:53.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.636+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2030369301 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f43a4065bd0 con 0x7f43ac105180 2024-09-21T00:37:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 msgr2=0x7f439807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 0x7f439807d4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43a8031440 tx=0x7f43a8009630 comp rx=0 tx=0).stop 2024-09-21T00:37:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 msgr2=0x7f43ac075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a400cce0 tx=0x7f43a400a620 comp rx=0 tx=0).stop 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 shutdown_connections 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f439807afd0 0x7f439807d4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac105180 0x7f43ac075c50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ac1047e0 0x7f43ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 --2- 172.21.15.16:0/2030369301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43ac103750 0x7f43ac076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 >> 172.21.15.16:0/2030369301 conn(0x7f43ac0ff0c0 msgr2=0x7f43ac107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 shutdown_connections 2024-09-21T00:37:53.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.639+0000 7f43b41b4640 1 -- 172.21.15.16:0/2030369301 wait complete. 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.797+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/394749486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f41037e0 msgr2=0x7fc6f4103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.797+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/394749486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f41037e0 0x7fc6f4103c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009ca0 tx=0x7fc6ec02a950 comp rx=0 tx=0).stop 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/394749486 shutdown_connections 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/394749486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4105210 0x7fc6f410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/394749486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f4104870 0x7fc6f4104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/394749486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f41037e0 0x7fc6f4103c50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/394749486 >> 172.21.15.16:0/394749486 conn(0x7fc6f40ff150 msgr2=0x7fc6f4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/394749486 shutdown_connections 2024-09-21T00:37:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/394749486 wait complete. 2024-09-21T00:37:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 Processor -- start 2024-09-21T00:37:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.798+0000 7fc6f9b8e640 1 -- start start 2024-09-21T00:37:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41037e0 0x7fc6f4199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4104870 0x7fc6f419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410f2c0 con 0x7fc6f4105210 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410f140 con 0x7fc6f41037e0 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f9b8e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f410f440 con 0x7fc6f4104870 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55798/0 (socket says 172.21.15.16:55798) 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 -- 172.21.15.16:0/4293465210 learned_addr learned my addr 172.21.15.16:0/4293465210 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f2ffd640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4104870 0x7fc6f419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f37fe640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41037e0 0x7fc6f4199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 -- 172.21.15.16:0/4293465210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4104870 msgr2=0x7fc6f419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4104870 0x7fc6f419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 -- 172.21.15.16:0/4293465210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41037e0 msgr2=0x7fc6f4199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41037e0 0x7fc6f4199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 -- 172.21.15.16:0/4293465210 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f419b8f0 con 0x7fc6f4105210 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.799+0000 7fc6f3fff640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d750 tx=0x7fc6e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.800+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4017070 con 0x7fc6f4105210 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.800+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f419bbe0 con 0x7fc6f4105210 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.800+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc6e40054b0 con 0x7fc6f4105210 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.800+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4004ba0 con 0x7fc6f4105210 2024-09-21T00:37:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.800+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f41a22e0 con 0x7fc6f4105210 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.801+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f4103c50 con 0x7fc6f4105210 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.802+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fc6e4004d40 con 0x7fc6f4105210 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.802+0000 7fc6f0ff9640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 0x7fc6e007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.802+0000 7fc6f37fe640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 0x7fc6e007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.802+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6e409c730 con 0x7fc6f4105210 2024-09-21T00:37:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.803+0000 7fc6f37fe640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 0x7fc6e007d4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec02af40 tx=0x7fc6ec005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:53.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.807+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6e4069190 con 0x7fc6f4105210 2024-09-21T00:37:54.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.999+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fc6f4063fc0 con 0x7fc6f4105210 2024-09-21T00:37:54.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.003+0000 7fc6f0ff9640 1 -- 172.21.15.16:0/4293465210 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v22)=0 v22) ==== 127+0+0 (secure 0 0 0) 0x7fc6e406e040 con 0x7fc6f4105210 2024-09-21T00:37:54.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 msgr2=0x7fc6e007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 0x7fc6e007d4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec02af40 tx=0x7fc6ec005d80 comp rx=0 tx=0).stop 2024-09-21T00:37:54.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 msgr2=0x7fc6f419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400d750 tx=0x7fc6e400dc10 comp rx=0 tx=0).stop 2024-09-21T00:37:54.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 shutdown_connections 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6e007afd0 0x7fc6e007d4e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4105210 0x7fc6f419b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f4104870 0x7fc6f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 --2- 172.21.15.16:0/4293465210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41037e0 0x7fc6f4199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 >> 172.21.15.16:0/4293465210 conn(0x7fc6f40ff150 msgr2=0x7fc6f4107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 shutdown_connections 2024-09-21T00:37:54.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.006+0000 7fc6f9b8e640 1 -- 172.21.15.16:0/4293465210 wait complete. 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 -- 172.21.15.16:0/3660381329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b010ac50 msgr2=0x7fe6b010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/3660381329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b010ac50 0x7fe6b010d0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009900 tx=0x7fe6a002a410 comp rx=0 tx=0).stop 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 -- 172.21.15.16:0/3660381329 shutdown_connections 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/3660381329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b0110310 0x7fe6b0112820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/3660381329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b010fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/3660381329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b010ac50 0x7fe6b010d0b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 -- 172.21.15.16:0/3660381329 >> 172.21.15.16:0/3660381329 conn(0x7fe6b0070950 msgr2=0x7fe6b0072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:54.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 -- 172.21.15.16:0/3660381329 shutdown_connections 2024-09-21T00:37:54.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.009+0000 7fe6b49b2640 1 -- 172.21.15.16:0/3660381329 wait complete. 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.010+0000 7fe6b49b2640 1 Processor -- start 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.010+0000 7fe6b49b2640 1 -- start start 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b010ac50 0x7fe6b01a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b01a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0115880 con 0x7fe6b0110310 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0115700 con 0x7fe6b010d6f0 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6b49b2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0115a00 con 0x7fe6b010ac50 2024-09-21T00:37:54.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6ae59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b010ac50 0x7fe6b01a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6add9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b01a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55820/0 (socket says 172.21.15.16:55820) 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 -- 172.21.15.16:0/286061246 learned_addr learned my addr 172.21.15.16:0/286061246 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6add9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b01a2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:55078/0 (socket says 172.21.15.16:55078) 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 -- 172.21.15.16:0/286061246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b010ac50 msgr2=0x7fe6b01a2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b010ac50 0x7fe6b01a2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 -- 172.21.15.16:0/286061246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 msgr2=0x7fe6b01a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b01a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 -- 172.21.15.16:0/286061246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b01a40c0 con 0x7fe6b0110310 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.011+0000 7fe6aed9d640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cce0 tx=0x7fe6a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.012+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800f450 con 0x7fe6b0110310 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.012+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe6a800fa80 con 0x7fe6b0110310 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.012+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b01a43b0 con 0x7fe6b0110310 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.012+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8018ae0 con 0x7fe6b0110310 2024-09-21T00:37:54.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.012+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b01a0160 con 0x7fe6b0110310 2024-09-21T00:37:54.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.013+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b0072470 con 0x7fe6b0110310 2024-09-21T00:37:54.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.014+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fe6a800f5f0 con 0x7fe6b0110310 2024-09-21T00:37:54.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.014+0000 7fe69f7fe640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 0x7fe69807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.014+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe6a809d460 con 0x7fe6b0110310 2024-09-21T00:37:54.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.014+0000 7fe6ae59c640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 0x7fe69807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.015+0000 7fe6ae59c640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 0x7fe69807d4e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009230 tx=0x7fe6a0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:54.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.019+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6a8014030 con 0x7fe6b0110310 2024-09-21T00:37:54.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.217+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe6b0063fc0 con 0x7fe6b0110310 2024-09-21T00:37:54.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:54.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/171775134' entity='client.admin' 2024-09-21T00:37:54.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: Standby manager daemon y started 2024-09-21T00:37:54.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:37:54.221 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:54.221 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:37:54.221 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:54.221 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:53 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2030369301' entity='client.admin' 2024-09-21T00:37:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.221+0000 7fe69f7fe640 1 -- 172.21.15.16:0/286061246 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7fe6a806e020 con 0x7fe6b0110310 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 msgr2=0x7fe69807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 0x7fe69807d4e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009230 tx=0x7fe6a0031400 comp rx=0 tx=0).stop 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 msgr2=0x7fe6b01a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cce0 tx=0x7fe6a800a620 comp rx=0 tx=0).stop 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 shutdown_connections 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe69807afd0 0x7fe69807d4e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6b0110310 0x7fe6b01a3930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6b010d6f0 0x7fe6b01a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 --2- 172.21.15.16:0/286061246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6b010ac50 0x7fe6b01a2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.223+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 >> 172.21.15.16:0/286061246 conn(0x7fe6b0070950 msgr2=0x7fe6b0111230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:54.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.224+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 shutdown_connections 2024-09-21T00:37:54.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.224+0000 7fe6b49b2640 1 -- 172.21.15.16:0/286061246 wait complete. 2024-09-21T00:37:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/171775134' entity='client.admin' 2024-09-21T00:37:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: Standby manager daemon y started 2024-09-21T00:37:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:37:54.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:54.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:37:54.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:54.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:53 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2030369301' entity='client.admin' 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/171775134' entity='client.admin' 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: Standby manager daemon y started 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='mgr.? 172.21.15.123:0/1303140229' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:37:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:53 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2030369301' entity='client.admin' 2024-09-21T00:37:54.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 -- 172.21.15.16:0/126404241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c104800 msgr2=0x7f2b1c104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 --2- 172.21.15.16:0/126404241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c104800 0x7f2b1c104c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009900 tx=0x7f2b1002a480 comp rx=0 tx=0).stop 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 -- 172.21.15.16:0/126404241 shutdown_connections 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 --2- 172.21.15.16:0/126404241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 --2- 172.21.15.16:0/126404241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c104800 0x7f2b1c104c10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 --2- 172.21.15.16:0/126404241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 0x7f2b1c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 -- 172.21.15.16:0/126404241 >> 172.21.15.16:0/126404241 conn(0x7f2b1c0ff0c0 msgr2=0x7f2b1c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 -- 172.21.15.16:0/126404241 shutdown_connections 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.934+0000 7f2b22076640 1 -- 172.21.15.16:0/126404241 wait complete. 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 Processor -- start 2024-09-21T00:37:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 -- start start 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 0x7f2b1c076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c104800 0x7f2b1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10f280 con 0x7f2b1c1051a0 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10f100 con 0x7f2b1c104800 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.935+0000 7f2b22076640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c10f400 con 0x7f2b1c103770 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53510/0 (socket says 172.21.15.16:53510) 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 -- 172.21.15.16:0/912153220 learned_addr learned my addr 172.21.15.16:0/912153220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1affd640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c104800 0x7f2b1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1b7fe640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 0x7f2b1c076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 -- 172.21.15.16:0/912153220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 msgr2=0x7f2b1c076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 0x7f2b1c076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 -- 172.21.15.16:0/912153220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c104800 msgr2=0x7f2b1c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c104800 0x7f2b1c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 -- 172.21.15.16:0/912153220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c0762c0 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b1bfff640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400cce0 tx=0x7f2b1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400f450 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1c1a3fa0 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2b1400fa80 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14018ae0 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.936+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1c1a4340 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.937+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1c10a950 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.939+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f2b1400f5f0 con 0x7f2b1c1051a0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.940+0000 7f2b18ff9640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 0x7f2b040b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.940+0000 7f2b1b7fe640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 0x7f2b040b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:54.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.940+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2b140e5d80 con 0x7f2b1c1051a0 2024-09-21T00:37:54.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.940+0000 7f2b1b7fe640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 0x7f2b040b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c005fd0 tx=0x7f2b0c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:54.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:54.944+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b14014030 con 0x7f2b1c1051a0 2024-09-21T00:37:55.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.137+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f2b1c063fc0 con 0x7f2b1c1051a0 2024-09-21T00:37:55.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4293465210' entity='client.admin' 2024-09-21T00:37:55.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:55 smithi016 ceph-mon[30947]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:55.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/286061246' entity='client.admin' 2024-09-21T00:37:55.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:55 smithi016 ceph-mon[30947]: mgrmap e16: x(active, since 68s), standbys: z, y 2024-09-21T00:37:55.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:37:55.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.142+0000 7f2b18ff9640 1 -- 172.21.15.16:0/912153220 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v24)=0 v24) ==== 116+0+0 (secure 0 0 0) 0x7f2b140ae2e0 con 0x7f2b1c1051a0 2024-09-21T00:37:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 msgr2=0x7f2b040b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 0x7f2b040b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c005fd0 tx=0x7f2b0c00b390 comp rx=0 tx=0).stop 2024-09-21T00:37:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 msgr2=0x7f2b1c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400cce0 tx=0x7f2b1400a620 comp rx=0 tx=0).stop 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 shutdown_connections 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2b040b6480 0x7f2b040b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b1c1051a0 0x7f2b1c075c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b1c104800 0x7f2b1c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 --2- 172.21.15.16:0/912153220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c103770 0x7f2b1c076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 >> 172.21.15.16:0/912153220 conn(0x7f2b1c0ff0c0 msgr2=0x7f2b1c107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 shutdown_connections 2024-09-21T00:37:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:55.144+0000 7f2b22076640 1 -- 172.21.15.16:0/912153220 wait complete. 2024-09-21T00:37:55.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4293465210' entity='client.admin' 2024-09-21T00:37:55.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:55 smithi123 ceph-mon[34853]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:55.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/286061246' entity='client.admin' 2024-09-21T00:37:55.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:55 smithi123 ceph-mon[34853]: mgrmap e16: x(active, since 68s), standbys: z, y 2024-09-21T00:37:55.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:37:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4293465210' entity='client.admin' 2024-09-21T00:37:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:55 smithi178 ceph-mon[34888]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/286061246' entity='client.admin' 2024-09-21T00:37:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:55 smithi178 ceph-mon[34888]: mgrmap e16: x(active, since 68s), standbys: z, y 2024-09-21T00:37:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:37:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 -- 172.21.15.16:0/4272471014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 msgr2=0x7f679410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 --2- 172.21.15.16:0/4272471014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679410b9b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f678c009ca0 tx=0x7f678c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 -- 172.21.15.16:0/4272471014 shutdown_connections 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 --2- 172.21.15.16:0/4272471014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679410b9b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 --2- 172.21.15.16:0/4272471014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f6794108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 --2- 172.21.15.16:0/4272471014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f67941063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 -- 172.21.15.16:0/4272471014 >> 172.21.15.16:0/4272471014 conn(0x7f67940fdfe0 msgr2=0x7f6794100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 -- 172.21.15.16:0/4272471014 shutdown_connections 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.023+0000 7f679a3a0640 1 -- 172.21.15.16:0/4272471014 wait complete. 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 Processor -- start 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 -- start start 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f6794199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f679410f280 con 0x7f67941094a0 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f679410f100 con 0x7f6794106900 2024-09-21T00:37:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679a3a0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f679410f400 con 0x7f679406c660 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679893d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f678bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679893d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55758/0 (socket says 172.21.15.16:55758) 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f678bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:55042/0 (socket says 172.21.15.16:55042) 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f679893d640 1 -- 172.21.15.16:0/171775134 learned_addr learned my addr 172.21.15.16:0/171775134 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.024+0000 7f6793fff640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f6794199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 -- 172.21.15.16:0/171775134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 msgr2=0x7f6794199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f6794199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 -- 172.21.15.16:0/171775134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 msgr2=0x7f679419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 -- 172.21.15.16:0/171775134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679419b8e0 con 0x7f67941094a0 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f678bfff640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:37:55.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f6793fff640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f6794199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679893d640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f678c006010 tx=0x7f678c0307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c030be0 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f678c031e00 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679419bb70 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0046d0 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.025+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67941a22d0 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.027+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6794106d50 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.027+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f678c04d440 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.028+0000 7f6791ffb640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 0x7f678007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.028+0000 7f6793fff640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 0x7f678007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.028+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f678c0bdc60 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.028+0000 7f6793fff640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 0x7f678007d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6784009c20 tx=0x7f6784005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.033+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f678c08a7d0 con 0x7f67941094a0 2024-09-21T00:37:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.229+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f6794063fc0 con 0x7f67941094a0 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.233+0000 7f6791ffb640 1 -- 172.21.15.16:0/171775134 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f678c08f680 con 0x7f67941094a0 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 msgr2=0x7f678007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 0x7f678007d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6784009c20 tx=0x7f6784005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 msgr2=0x7f679419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f678c006010 tx=0x7f678c0307f0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 shutdown_connections 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f678007afd0 0x7f678007d4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67941094a0 0x7f679419b0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6794106900 0x7f679419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 --2- 172.21.15.16:0/171775134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406c660 0x7f6794199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 >> 172.21.15.16:0/171775134 conn(0x7f67940fdfe0 msgr2=0x7f6794104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 shutdown_connections 2024-09-21T00:37:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:53.236+0000 7f679a3a0640 1 -- 172.21.15.16:0/171775134 wait complete. 2024-09-21T00:37:56.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:56 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/912153220' entity='client.admin' 2024-09-21T00:37:56.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:56 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/912153220' entity='client.admin' 2024-09-21T00:37:56.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:56 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/912153220' entity='client.admin' 2024-09-21T00:37:57.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:57 smithi016 ceph-mon[30947]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:57.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1681051915' entity='client.admin' 2024-09-21T00:37:57.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1742629449' entity='client.admin' 2024-09-21T00:37:57.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:57 smithi123 ceph-mon[34853]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:57.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1681051915' entity='client.admin' 2024-09-21T00:37:57.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1742629449' entity='client.admin' 2024-09-21T00:37:57.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:57 smithi178 ceph-mon[34888]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:57.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1681051915' entity='client.admin' 2024-09-21T00:37:57.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1742629449' entity='client.admin' 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 -- 172.21.15.16:0/1205423855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef41040b0 msgr2=0x7f6ef410aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1205423855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef41040b0 0x7f6ef410aa50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009ca0 tx=0x7f6eec02a950 comp rx=0 tx=0).stop 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 -- 172.21.15.16:0/1205423855 shutdown_connections 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1205423855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef41040b0 0x7f6ef410aa50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1205423855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 0x7f6ef4103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1205423855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef4102680 0x7f6ef4102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 -- 172.21.15.16:0/1205423855 >> 172.21.15.16:0/1205423855 conn(0x7f6ef40fe010 msgr2=0x7f6ef41004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 -- 172.21.15.16:0/1205423855 shutdown_connections 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.049+0000 7f6efbe93640 1 -- 172.21.15.16:0/1205423855 wait complete. 2024-09-21T00:37:57.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 Processor -- start 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 -- start start 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 0x7f6ef4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef41040b0 0x7f6ef4199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef410e170 con 0x7f6ef4102680 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef410dff0 con 0x7f6ef41040b0 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efbe93640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef410e2f0 con 0x7f6ef4103710 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6ef9c2f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6ef9c2f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53528/0 (socket says 172.21.15.16:53528) 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6ef9c2f640 1 -- 172.21.15.16:0/1681051915 learned_addr learned my addr 172.21.15.16:0/1681051915 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.050+0000 7f6efa430640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef41040b0 0x7f6ef4199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef942e640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 0x7f6ef4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 -- 172.21.15.16:0/1681051915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 msgr2=0x7f6ef4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 0x7f6ef4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 -- 172.21.15.16:0/1681051915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef41040b0 msgr2=0x7f6ef4199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef41040b0 0x7f6ef4199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 -- 172.21.15.16:0/1681051915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef419a720 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6ef9c2f640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000d950 tx=0x7f6ef000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0017070 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6ef0009c30 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef419a9b0 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000f620 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.051+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef406bb40 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.052+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef406c560 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.054+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f6ef0010460 con 0x7f6ef4102680 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.056+0000 7f6eeaffd640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 0x7f6ee00b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.056+0000 7f6ef942e640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 0x7f6ee00b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.056+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6ef00e5200 con 0x7f6ef4102680 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.056+0000 7f6ef942e640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 0x7f6ee00b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4005e10 tx=0x7f6ee4005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.058+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ef00ad760 con 0x7f6ef4102680 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.253+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f6ef406c730 con 0x7f6ef4102680 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.258+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f6ef0009de0 con 0x7f6ef4102680 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.260+0000 7f6eeaffd640 1 -- 172.21.15.16:0/1681051915 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ef00acb70 con 0x7f6ef4102680 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 msgr2=0x7f6ee00b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 0x7f6ee00b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4005e10 tx=0x7f6ee4005da0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 msgr2=0x7f6ef4198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000d950 tx=0x7f6ef000de10 comp rx=0 tx=0).stop 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 shutdown_connections 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6ee00b6480 0x7f6ee00b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef41040b0 0x7f6ef4199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef4103710 0x7f6ef4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 --2- 172.21.15.16:0/1681051915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef4102680 0x7f6ef4198df0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 >> 172.21.15.16:0/1681051915 conn(0x7f6ef40fe010 msgr2=0x7f6ef4106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 shutdown_connections 2024-09-21T00:37:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.261+0000 7f6efbe93640 1 -- 172.21.15.16:0/1681051915 wait complete. 2024-09-21T00:37:57.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 -- 172.21.15.16:0/2094713148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c109480 msgr2=0x7fcb8c10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 --2- 172.21.15.16:0/2094713148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c109480 0x7fcb8c10b990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009ca0 tx=0x7fcb8402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 -- 172.21.15.16:0/2094713148 shutdown_connections 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 --2- 172.21.15.16:0/2094713148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c109480 0x7fcb8c10b990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 --2- 172.21.15.16:0/2094713148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c106940 0x7fcb8c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 --2- 172.21.15.16:0/2094713148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 -- 172.21.15.16:0/2094713148 >> 172.21.15.16:0/2094713148 conn(0x7fcb8c0fdfa0 msgr2=0x7fcb8c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 -- 172.21.15.16:0/2094713148 shutdown_connections 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.149+0000 7fcb908ae640 1 -- 172.21.15.16:0/2094713148 wait complete. 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 Processor -- start 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 -- start start 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c109480 0x7fcb8c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10f230 con 0x7fcb8c106940 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10f0b0 con 0x7fcb8c109480 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb908ae640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10f3b0 con 0x7fcb8c06c2e0 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.150+0000 7fcb81d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53544/0 (socket says 172.21.15.16:53544) 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 -- 172.21.15.16:0/1742629449 learned_addr learned my addr 172.21.15.16:0/1742629449 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb8a59c640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb8ad9d640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c109480 0x7fcb8c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 -- 172.21.15.16:0/1742629449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 msgr2=0x7fcb8c199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 -- 172.21.15.16:0/1742629449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c109480 msgr2=0x7fcb8c19b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c109480 0x7fcb8c19b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 -- 172.21.15.16:0/1742629449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c19b880 con 0x7fcb8c106940 2024-09-21T00:37:57.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb8a59c640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb81d9b640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e9f0 tx=0x7fcb7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400cd80 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcb740108c0 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740187d0 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c19bb70 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.151+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a2270 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.153+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8c0ffac0 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.155+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fcb74010430 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.156+0000 7fcb83fff640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 0x7fcb780b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.156+0000 7fcb8a59c640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 0x7fcb780b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.156+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcb740e5ef0 con 0x7fcb8c106940 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.157+0000 7fcb8a59c640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 0x7fcb780b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009c20 tx=0x7fcb7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:57.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.158+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb740ae450 con 0x7fcb8c106940 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.260+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb740ad860 con 0x7fcb8c106940 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.353+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fcb8c02e640 con 0x7fcb8c106940 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.357+0000 7fcb83fff640 1 -- 172.21.15.16:0/1742629449 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fcb740b7770 con 0x7fcb8c106940 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 msgr2=0x7fcb780b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 0x7fcb780b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009c20 tx=0x7fcb7c005f90 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 msgr2=0x7fcb8c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e9f0 tx=0x7fcb7400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 shutdown_connections 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcb780b6500 0x7fcb780b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb8c109480 0x7fcb8c19b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c106940 0x7fcb8c19a4c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 --2- 172.21.15.16:0/1742629449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8c06c2e0 0x7fcb8c199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:57.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 >> 172.21.15.16:0/1742629449 conn(0x7fcb8c0fdfa0 msgr2=0x7fcb8c104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:57.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 shutdown_connections 2024-09-21T00:37:57.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:56.360+0000 7fcb908ae640 1 -- 172.21.15.16:0/1742629449 wait complete. 2024-09-21T00:37:58.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/1244200953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 msgr2=0x7fc99c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/1244200953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c103bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009900 tx=0x7fc98c02a480 comp rx=0 tx=0).stop 2024-09-21T00:37:58.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/1244200953 shutdown_connections 2024-09-21T00:37:58.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/1244200953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 0x7fc99c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/1244200953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/1244200953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c103bc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/1244200953 >> 172.21.15.16:0/1244200953 conn(0x7fc99c0ff0c0 msgr2=0x7fc99c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/1244200953 shutdown_connections 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.356+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/1244200953 wait complete. 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 Processor -- start 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 -- start start 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 0x7fc99c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.357+0000 7fc9a1ba3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10f370 con 0x7fc99c103750 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc9a1ba3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10f1f0 con 0x7fc99c105180 2024-09-21T00:37:58.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc9a1ba3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c10f4f0 con 0x7fc99c1047e0 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53550/0 (socket says 172.21.15.16:53550) 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 -- 172.21.15.16:0/684606568 learned_addr learned my addr 172.21.15.16:0/684606568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99bfff640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 0x7fc99c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99affd640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 -- 172.21.15.16:0/684606568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 msgr2=0x7fc99c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 -- 172.21.15.16:0/684606568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 msgr2=0x7fc99c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 0x7fc99c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 -- 172.21.15.16:0/684606568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c0762f0 con 0x7fc99c103750 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99affd640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:37:58.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc99b7fe640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006010 tx=0x7fc98c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c03f030 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc98c003cb0 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c035070 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.358+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1a40b0 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.359+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a4450 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.359+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c10a930 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.362+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fc98c042030 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.363+0000 7fc998ff9640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 0x7fc9840b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.363+0000 7fc99affd640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 0x7fc9840b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.363+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc98c106430 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.364+0000 7fc99affd640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 0x7fc9840b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9900058c0 tx=0x7fc990005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.366+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc98c0ce990 con 0x7fc99c103750 2024-09-21T00:37:58.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.555+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fc99c02e640 con 0x7fc99c103750 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.559+0000 7fc998ff9640 1 -- 172.21.15.16:0/684606568 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fc98c003e60 con 0x7fc99c103750 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 msgr2=0x7fc9840b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 0x7fc9840b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9900058c0 tx=0x7fc990005ec0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 msgr2=0x7fc99c076dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006010 tx=0x7fc98c004340 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 shutdown_connections 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9840b6480 0x7fc9840b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc99c105180 0x7fc99c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc99c1047e0 0x7fc99c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 --2- 172.21.15.16:0/684606568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99c103750 0x7fc99c076dd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 >> 172.21.15.16:0/684606568 conn(0x7fc99c0ff0c0 msgr2=0x7fc99c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 shutdown_connections 2024-09-21T00:37:58.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.562+0000 7fc9a1ba3640 1 -- 172.21.15.16:0/684606568 wait complete. 2024-09-21T00:37:58.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:58 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/684606568' entity='client.admin' 2024-09-21T00:37:58.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:58 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3317254297' entity='client.admin' 2024-09-21T00:37:58.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 -- 172.21.15.16:0/1992647182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c106900 msgr2=0x7f647c108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 --2- 172.21.15.16:0/1992647182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c106900 0x7f647c108d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6470009900 tx=0x7f647002a410 comp rx=0 tx=0).stop 2024-09-21T00:37:58.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 -- 172.21.15.16:0/1992647182 shutdown_connections 2024-09-21T00:37:58.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 --2- 172.21.15.16:0/1992647182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c1094a0 0x7f647c10b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 --2- 172.21.15.16:0/1992647182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c106900 0x7f647c108d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 --2- 172.21.15.16:0/1992647182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c06c680 0x7f647c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 -- 172.21.15.16:0/1992647182 >> 172.21.15.16:0/1992647182 conn(0x7f647c0fdfe0 msgr2=0x7f647c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 -- 172.21.15.16:0/1992647182 shutdown_connections 2024-09-21T00:37:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 -- 172.21.15.16:0/1992647182 wait complete. 2024-09-21T00:37:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.959+0000 7f648131d640 1 Processor -- start 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 -- start start 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 0x7f647c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c106900 0x7f647c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c10f3e0 con 0x7f647c1094a0 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f647c10f260 con 0x7f647c06c680 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f648131d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f647c10f560 con 0x7f647c106900 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53584/0 (socket says 172.21.15.16:53584) 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 -- 172.21.15.16:0/998417487 learned_addr learned my addr 172.21.15.16:0/998417487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647a7fc640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c106900 0x7f647c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647affd640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 0x7f647c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 -- 172.21.15.16:0/998417487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c106900 msgr2=0x7f647c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c106900 0x7f647c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 -- 172.21.15.16:0/998417487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 msgr2=0x7f647c199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 0x7f647c199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647b7fe640 1 -- 172.21.15.16:0/998417487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c19ba00 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.960+0000 7f647affd640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 0x7f647c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f647b7fe640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f647400eaa0 tx=0x7f647400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647400cdb0 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c19bcf0 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6474005020 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64740116d0 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.961+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1a23f0 con 0x7f647c1094a0 2024-09-21T00:37:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.962+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c0ffb00 con 0x7f647c1094a0 2024-09-21T00:37:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.964+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f64740051d0 con 0x7f647c1094a0 2024-09-21T00:37:58.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.965+0000 7f6463fff640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 0x7f64640b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:37:58.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.965+0000 7f647affd640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 0x7f64640b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:37:58.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.965+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f64740e5ba0 con 0x7f647c1094a0 2024-09-21T00:37:58.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.966+0000 7f647affd640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 0x7f64640b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f646c005d00 tx=0x7f646c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:37:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:58.968+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6474016030 con 0x7f647c1094a0 2024-09-21T00:37:59.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:58 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/684606568' entity='client.admin' 2024-09-21T00:37:59.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:58 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3317254297' entity='client.admin' 2024-09-21T00:37:59.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:58 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/684606568' entity='client.admin' 2024-09-21T00:37:59.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:58 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3317254297' entity='client.admin' 2024-09-21T00:37:59.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.159+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f647c02e640 con 0x7f647c1094a0 2024-09-21T00:37:59.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.164+0000 7f6463fff640 1 -- 172.21.15.16:0/998417487 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f64740ae0e0 con 0x7f647c1094a0 2024-09-21T00:37:59.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 msgr2=0x7f64640b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:59.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 0x7f64640b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f646c005d00 tx=0x7f646c005c70 comp rx=0 tx=0).stop 2024-09-21T00:37:59.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 msgr2=0x7f647c19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:37:59.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f647400eaa0 tx=0x7f647400ef60 comp rx=0 tx=0).stop 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 shutdown_connections 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f64640b6480 0x7f64640b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c1094a0 0x7f647c19b1e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c106900 0x7f647c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 --2- 172.21.15.16:0/998417487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c06c680 0x7f647c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 >> 172.21.15.16:0/998417487 conn(0x7f647c0fdfe0 msgr2=0x7f647c104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 shutdown_connections 2024-09-21T00:37:59.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:59.166+0000 7f648131d640 1 -- 172.21.15.16:0/998417487 wait complete. 2024-09-21T00:37:59.979 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:59 smithi016 ceph-mon[30947]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:37:59.979 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:37:59 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/998417487' entity='client.admin' 2024-09-21T00:38:00.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:59 smithi178 ceph-mon[34888]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:00.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:37:59 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/998417487' entity='client.admin' 2024-09-21T00:38:00.240 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:59 smithi123 ceph-mon[34853]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:00.241 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:37:59 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/998417487' entity='client.admin' 2024-09-21T00:38:00.559 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-21T00:38:01.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:01 smithi016 ceph-mon[30947]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:01.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 -- 172.21.15.16:0/2247977225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 msgr2=0x7f5a18102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:01.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 --2- 172.21.15.16:0/2247977225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18102ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a0802a480 comp rx=0 tx=0).stop 2024-09-21T00:38:01.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 -- 172.21.15.16:0/2247977225 shutdown_connections 2024-09-21T00:38:01.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 --2- 172.21.15.16:0/2247977225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 0x7f5a1810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:01.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 --2- 172.21.15.16:0/2247977225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:01.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 --2- 172.21.15.16:0/2247977225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18102ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:01.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 -- 172.21.15.16:0/2247977225 >> 172.21.15.16:0/2247977225 conn(0x7f5a180fdfb0 msgr2=0x7f5a18100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:01.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 -- 172.21.15.16:0/2247977225 shutdown_connections 2024-09-21T00:38:01.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.833+0000 7f5a1d873640 1 -- 172.21.15.16:0/2247977225 wait complete. 2024-09-21T00:38:01.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 Processor -- start 2024-09-21T00:38:01.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 -- start start 2024-09-21T00:38:01.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:01.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 0x7f5a18105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1810e260 con 0x7f5a18102640 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1810e0e0 con 0x7f5a18104070 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a1d873640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1810e3e0 con 0x7f5a181036d0 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53602/0 (socket says 172.21.15.16:53602) 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.834+0000 7f5a16ffd640 1 -- 172.21.15.16:0/3971963799 learned_addr learned my addr 172.21.15.16:0/3971963799 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a177fe640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 0x7f5a18105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a167fc640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 -- 172.21.15.16:0/3971963799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 msgr2=0x7f5a18104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:01.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 -- 172.21.15.16:0/3971963799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 msgr2=0x7f5a18105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 0x7f5a18105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 -- 172.21.15.16:0/3971963799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a18105740 con 0x7f5a18102640 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a167fc640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a16ffd640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a08006010 tx=0x7f5a08004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0803f030 con 0x7f5a18102640 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a08003cb0 con 0x7f5a18102640 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a181a4040 con 0x7f5a18102640 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08035070 con 0x7f5a18102640 2024-09-21T00:38:01.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.835+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a181a4430 con 0x7f5a18102640 2024-09-21T00:38:01.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.836+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a18102ab0 con 0x7f5a18102640 2024-09-21T00:38:01.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.838+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f5a08042030 con 0x7f5a18102640 2024-09-21T00:38:01.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.838+0000 7f5a1c871640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 0x7f5a000b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:01.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.839+0000 7f5a167fc640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 0x7f5a000b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:01.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.839+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5a08105ce0 con 0x7f5a18102640 2024-09-21T00:38:01.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.839+0000 7f5a167fc640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 0x7f5a000b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009b40 tx=0x7f5a0c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:01.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:01.843+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a080ce240 con 0x7f5a18102640 2024-09-21T00:38:02.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.032+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f5a181a46e0 con 0x7f5a18102640 2024-09-21T00:38:02.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:01 smithi178 ceph-mon[34888]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:02.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.036+0000 7f5a1c871640 1 -- 172.21.15.16:0/3971963799 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7f5a080d2620 con 0x7f5a18102640 2024-09-21T00:38:02.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 msgr2=0x7f5a000b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:02.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 0x7f5a000b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009b40 tx=0x7f5a0c005e50 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 msgr2=0x7f5a18106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a08006010 tx=0x7f5a08004340 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 shutdown_connections 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.038+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5a000b6500 0x7f5a000b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a18104070 0x7f5a18105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a181036d0 0x7f5a18104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 --2- 172.21.15.16:0/3971963799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a18102640 0x7f5a18106230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 >> 172.21.15.16:0/3971963799 conn(0x7f5a180fdfb0 msgr2=0x7f5a180ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 shutdown_connections 2024-09-21T00:38:02.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:02.039+0000 7f5a1d873640 1 -- 172.21.15.16:0/3971963799 wait complete. 2024-09-21T00:38:02.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:01 smithi123 ceph-mon[34853]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:03.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:03 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3971963799' entity='client.admin' 2024-09-21T00:38:03.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:03 smithi016 ceph-mon[30947]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:03.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:03 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3971963799' entity='client.admin' 2024-09-21T00:38:03.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:03 smithi123 ceph-mon[34853]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:03.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:03 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3971963799' entity='client.admin' 2024-09-21T00:38:03.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:03 smithi178 ceph-mon[34888]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 -- 172.21.15.16:0/103286592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 msgr2=0x7f4bc8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/103286592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8102ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009900 tx=0x7f4bb802a480 comp rx=0 tx=0).stop 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 -- 172.21.15.16:0/103286592 shutdown_connections 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/103286592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc8104070 0x7f4bc810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/103286592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc81036d0 0x7f4bc8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/103286592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8102ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 -- 172.21.15.16:0/103286592 >> 172.21.15.16:0/103286592 conn(0x7f4bc80fdfb0 msgr2=0x7f4bc8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 -- 172.21.15.16:0/103286592 shutdown_connections 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.035+0000 7f4bccd4d640 1 -- 172.21.15.16:0/103286592 wait complete. 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 Processor -- start 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 -- start start 2024-09-21T00:38:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc81036d0 0x7f4bc8104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc8104070 0x7f4bc8105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810e280 con 0x7f4bc8102640 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810e100 con 0x7f4bc81036d0 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bccd4d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810e400 con 0x7f4bc8104070 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bc659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bc659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53628/0 (socket says 172.21.15.16:53628) 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bc659c640 1 -- 172.21.15.16:0/72365047 learned_addr learned my addr 172.21.15.16:0/72365047 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.036+0000 7f4bbffff640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc81036d0 0x7f4bc8104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc6d9d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc8104070 0x7f4bc8105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 -- 172.21.15.16:0/72365047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc8104070 msgr2=0x7f4bc8105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc8104070 0x7f4bc8105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 -- 172.21.15.16:0/72365047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc81036d0 msgr2=0x7f4bc8104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc81036d0 0x7f4bc8104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 -- 172.21.15.16:0/72365047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8105740 con 0x7f4bc8102640 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bc659c640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006010 tx=0x7f4bb8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb803f030 con 0x7f4bc8102640 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc81a40b0 con 0x7f4bc8102640 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb8003aa0 con 0x7f4bc8102640 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8035070 con 0x7f4bc8102640 2024-09-21T00:38:04.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.037+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc81a44a0 con 0x7f4bc8102640 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.038+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8102ab0 con 0x7f4bc8102640 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.040+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f4bb8042030 con 0x7f4bc8102640 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.041+0000 7f4bbf7fe640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 0x7f4bb40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.041+0000 7f4bbffff640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 0x7f4bb40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.041+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4bb81061d0 con 0x7f4bc8102640 2024-09-21T00:38:04.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.041+0000 7f4bbffff640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 0x7f4bb40b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009bd0 tx=0x7f4bb0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.044+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bb80d2b10 con 0x7f4bc8102640 2024-09-21T00:38:04.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.235+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f4bc81a47c0 con 0x7f4bc8102640 2024-09-21T00:38:04.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.236+0000 7f4bbf7fe640 1 -- 172.21.15.16:0/72365047 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f4bb80d7a50 con 0x7f4bc8102640 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 msgr2=0x7f4bb40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 0x7f4bb40b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009bd0 tx=0x7f4bb0005f90 comp rx=0 tx=0).stop 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 msgr2=0x7f4bc8106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006010 tx=0x7f4bb8031a50 comp rx=0 tx=0).stop 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 shutdown_connections 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4bb40b6500 0x7f4bb40b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bc8104070 0x7f4bc8105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bc81036d0 0x7f4bc8104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 --2- 172.21.15.16:0/72365047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bc8102640 0x7f4bc8106230 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 >> 172.21.15.16:0/72365047 conn(0x7f4bc80fdfb0 msgr2=0x7f4bc80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:04.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 shutdown_connections 2024-09-21T00:38:04.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:04.238+0000 7f4bccd4d640 1 -- 172.21.15.16:0/72365047 wait complete. 2024-09-21T00:38:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.573+0000 7f7ce8892640 1 -- 172.21.15.16:0/626898094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4103700 msgr2=0x7f7ce4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.573+0000 7f7ce8892640 1 --2- 172.21.15.16:0/626898094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4103700 0x7f7ce4103b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009900 tx=0x7f7cd802a480 comp rx=0 tx=0).stop 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 -- 172.21.15.16:0/626898094 shutdown_connections 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 --2- 172.21.15.16:0/626898094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce41040a0 0x7f7ce410aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 --2- 172.21.15.16:0/626898094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4103700 0x7f7ce4103b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 --2- 172.21.15.16:0/626898094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce4102670 0x7f7ce4102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 -- 172.21.15.16:0/626898094 >> 172.21.15.16:0/626898094 conn(0x7f7ce40fdfe0 msgr2=0x7f7ce4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 -- 172.21.15.16:0/626898094 shutdown_connections 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 -- 172.21.15.16:0/626898094 wait complete. 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.574+0000 7f7ce8892640 1 Processor -- start 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 -- start start 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 0x7f7ce4104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41040a0 0x7f7ce4105070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410e310 con 0x7f7ce4102670 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410e190 con 0x7f7ce4103700 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce8892640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410e490 con 0x7f7ce41040a0 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53572/0 (socket says 172.21.15.16:53572) 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 -- 172.21.15.16:0/3317254297 learned_addr learned my addr 172.21.15.16:0/3317254297 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce1d9b640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 0x7f7ce4104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce2d9d640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41040a0 0x7f7ce4105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 -- 172.21.15.16:0/3317254297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41040a0 msgr2=0x7f7ce4105070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41040a0 0x7f7ce4105070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 -- 172.21.15.16:0/3317254297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 msgr2=0x7f7ce4104b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 0x7f7ce4104b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce259c640 1 -- 172.21.15.16:0/3317254297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce4105770 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.575+0000 7f7ce1d9b640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 0x7f7ce4104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7ce259c640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400e9f0 tx=0x7f7cd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400cd80 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce41a4070 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd40054d0 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4010690 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.576+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce41a44d0 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.577+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce41a4790 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.578+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f7cd4004e30 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.579+0000 7f7cd37fe640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 0x7f7ccc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.579+0000 7f7ce1d9b640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 0x7f7ccc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.579+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7cd40e5be0 con 0x7f7ce4102670 2024-09-21T00:38:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.580+0000 7f7ce1d9b640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 0x7f7ccc0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8004770 tx=0x7f7cd80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.583+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cd40ae140 con 0x7f7ce4102670 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.775+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7ce41a4960 con 0x7f7ce4102670 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.779+0000 7f7cd37fe640 1 -- 172.21.15.16:0/3317254297 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f7cd40b2520 con 0x7f7ce4102670 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 msgr2=0x7f7ccc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 0x7f7ccc0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8004770 tx=0x7f7cd80314a0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 msgr2=0x7f7ce4106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400e9f0 tx=0x7f7cd400edf0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 shutdown_connections 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ccc0b6480 0x7f7ccc0b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41040a0 0x7f7ce4105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ce4103700 0x7f7ce4104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 --2- 172.21.15.16:0/3317254297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce4102670 0x7f7ce4106260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 >> 172.21.15.16:0/3317254297 conn(0x7f7ce40fdfe0 msgr2=0x7f7ce40ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 shutdown_connections 2024-09-21T00:38:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:37:57.781+0000 7f7ce8892640 1 -- 172.21.15.16:0/3317254297 wait complete. 2024-09-21T00:38:04.708 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:38:05.146 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.146 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.146 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:05.180 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-21T00:38:05.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:05.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:05.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:05 smithi016 ceph-mon[30947]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:06.081 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:05 smithi123 ceph-mon[34853]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:05 smithi178 ceph-mon[34888]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-21T00:38:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- 172.21.15.16:0/3626117548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44103710 msgr2=0x7f3e44103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 --2- 172.21.15.16:0/3626117548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44103710 0x7f3e44103b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009900 tx=0x7f3e2c02a480 comp rx=0 tx=0).stop 2024-09-21T00:38:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- 172.21.15.16:0/3626117548 shutdown_connections 2024-09-21T00:38:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 --2- 172.21.15.16:0/3626117548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e4410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 --2- 172.21.15.16:0/3626117548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44103710 0x7f3e44103b20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 --2- 172.21.15.16:0/3626117548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44102680 0x7f3e44102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- 172.21.15.16:0/3626117548 >> 172.21.15.16:0/3626117548 conn(0x7f3e440fe010 msgr2=0x7f3e441004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- 172.21.15.16:0/3626117548 shutdown_connections 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- 172.21.15.16:0/3626117548 wait complete. 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 Processor -- start 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.684+0000 7f3e49b50640 1 -- start start 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44103710 0x7f3e4419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e441a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4410e2d0 con 0x7f3e44102680 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4410e150 con 0x7f3e44103710 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e49b50640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4410e450 con 0x7f3e441040b0 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43386/0 (socket says 172.21.15.16:43386) 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 -- 172.21.15.16:0/2327697707 learned_addr learned my addr 172.21.15.16:0/2327697707 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e3affd640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44103710 0x7f3e4419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e43fff640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e441a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 -- 172.21.15.16:0/2327697707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 msgr2=0x7f3e441a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e441a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 -- 172.21.15.16:0/2327697707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44103710 msgr2=0x7f3e4419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44103710 0x7f3e4419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 -- 172.21.15.16:0/2327697707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441a1a90 con 0x7f3e44102680 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e43fff640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e441a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.685+0000 7f3e437fe640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d950 tx=0x7f3e3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.686+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34017070 con 0x7f3e44102680 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.686+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e34009c30 con 0x7f3e44102680 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.686+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e441a1d80 con 0x7f3e44102680 2024-09-21T00:38:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.686+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400f620 con 0x7f3e44102680 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.686+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e441a2200 con 0x7f3e44102680 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.687+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e44109840 con 0x7f3e44102680 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.689+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f3e34010460 con 0x7f3e44102680 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.690+0000 7f3e417fa640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 0x7f3e300b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.690+0000 7f3e3affd640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 0x7f3e300b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.690+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3e340e5260 con 0x7f3e44102680 2024-09-21T00:38:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.691+0000 7f3e3affd640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 0x7f3e300b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c00 tx=0x7f3e2c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.693+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e340ad7c0 con 0x7f3e44102680 2024-09-21T00:38:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.884+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3e4402e640 con 0x7f3e44102680 2024-09-21T00:38:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.884+0000 7f3e417fa640 1 -- 172.21.15.16:0/2327697707 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v31)=0 v31) ==== 106+0+0 (secure 0 0 0) 0x7f3e34009de0 con 0x7f3e44102680 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 msgr2=0x7f3e300b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 0x7f3e300b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000c00 tx=0x7f3e2c031400 comp rx=0 tx=0).stop 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 msgr2=0x7f3e4406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d950 tx=0x7f3e3400de10 comp rx=0 tx=0).stop 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 shutdown_connections 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f3e300b6480 0x7f3e300b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e441040b0 0x7f3e441a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e44103710 0x7f3e4419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 --2- 172.21.15.16:0/2327697707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e44102680 0x7f3e4406c380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 >> 172.21.15.16:0/2327697707 conn(0x7f3e440fe010 msgr2=0x7f3e44106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 shutdown_connections 2024-09-21T00:38:06.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.887+0000 7f3e49b50640 1 -- 172.21.15.16:0/2327697707 wait complete. 2024-09-21T00:38:07.230 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi016') 2024-09-21T00:38:07.230 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-21T00:38:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 -- 172.21.15.16:0/3223530703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940770e0 msgr2=0x7fa1940757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 --2- 172.21.15.16:0/3223530703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940770e0 0x7fa1940757b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa190009900 tx=0x7fa19002a410 comp rx=0 tx=0).stop 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 -- 172.21.15.16:0/3223530703 shutdown_connections 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 --2- 172.21.15.16:0/3223530703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa19410b710 0x7fa19410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 --2- 172.21.15.16:0/3223530703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 0x7fa194076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 --2- 172.21.15.16:0/3223530703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940770e0 0x7fa1940757b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.397+0000 7fa19bfda640 1 -- 172.21.15.16:0/3223530703 >> 172.21.15.16:0/3223530703 conn(0x7fa1940ff0c0 msgr2=0x7fa194101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- 172.21.15.16:0/3223530703 shutdown_connections 2024-09-21T00:38:07.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- 172.21.15.16:0/3223530703 wait complete. 2024-09-21T00:38:07.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 Processor -- start 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- start start 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 0x7fa19419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 0x7fa19419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa194111600 con 0x7fa19410b710 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa194111480 con 0x7fa194075cf0 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.398+0000 7fa19bfda640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa194111780 con 0x7fa1940770e0 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43410/0 (socket says 172.21.15.16:43410) 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 -- 172.21.15.16:0/288274821 learned_addr learned my addr 172.21.15.16:0/288274821 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa199d76640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 0x7fa19419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:07.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa199575640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 0x7fa19419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 -- 172.21.15.16:0/288274821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 msgr2=0x7fa19419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 0x7fa19419c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 -- 172.21.15.16:0/288274821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 msgr2=0x7fa19419c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 0x7fa19419c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 -- 172.21.15.16:0/288274821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19419dc60 con 0x7fa19410b710 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa199575640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 0x7fa19419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19a577640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00b970 tx=0x7fa18c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c019070 con 0x7fa19410b710 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19419df50 con 0x7fa19410b710 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa18c014440 con 0x7fa19410b710 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.399+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1941a4650 con 0x7fa19410b710 2024-09-21T00:38:07.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.400+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0075d0 con 0x7fa19410b710 2024-09-21T00:38:07.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.401+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1941a4820 con 0x7fa19410b710 2024-09-21T00:38:07.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.402+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fa18c01c070 con 0x7fa19410b710 2024-09-21T00:38:07.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.403+0000 7fa18affd640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 0x7fa1800b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:07.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.403+0000 7fa199d76640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 0x7fa1800b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:07.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.403+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa18c0e5000 con 0x7fa19410b710 2024-09-21T00:38:07.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.403+0000 7fa199d76640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 0x7fa1800b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:07.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.406+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa18c0b18a0 con 0x7fa19410b710 2024-09-21T00:38:07.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.595+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fa1941a49f0 con 0x7fa19410b710 2024-09-21T00:38:07.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.599+0000 7fa18affd640 1 -- 172.21.15.16:0/288274821 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v32)=0 v32) ==== 111+0+0 (secure 0 0 0) 0x7fa18c0b67e0 con 0x7fa19410b710 2024-09-21T00:38:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 msgr2=0x7fa1800b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 0x7fa1800b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190031400 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 msgr2=0x7fa19419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00b970 tx=0x7fa18c00be30 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 shutdown_connections 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa1800b6500 0x7fa1800b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa19410b710 0x7fa19419d440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1940770e0 0x7fa19419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 --2- 172.21.15.16:0/288274821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa194075cf0 0x7fa19419c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 >> 172.21.15.16:0/288274821 conn(0x7fa1940ff0c0 msgr2=0x7fa1940ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 shutdown_connections 2024-09-21T00:38:07.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:07.601+0000 7fa19bfda640 1 -- 172.21.15.16:0/288274821 wait complete. 2024-09-21T00:38:07.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:07 smithi016 ceph-mon[30947]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:07.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:07 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1193307230' entity='client.admin' 2024-09-21T00:38:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:07 smithi123 ceph-mon[34853]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:07 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1193307230' entity='client.admin' 2024-09-21T00:38:07.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:07 smithi178 ceph-mon[34888]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:07.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:07 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1193307230' entity='client.admin' 2024-09-21T00:38:08.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:08 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/288274821' entity='client.admin' 2024-09-21T00:38:08.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:08.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:09.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:08 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/288274821' entity='client.admin' 2024-09-21T00:38:09.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:09.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:09.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:09.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:09.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:08 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/288274821' entity='client.admin' 2024-09-21T00:38:09.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:09.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:09.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:09.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:09.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 -- 172.21.15.16:0/3883392616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 msgr2=0x7f4c14102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:09.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 --2- 172.21.15.16:0/3883392616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c14102b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009900 tx=0x7f4c0402a480 comp rx=0 tx=0).stop 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 -- 172.21.15.16:0/3883392616 shutdown_connections 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 --2- 172.21.15.16:0/3883392616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c141040c0 0x7f4c1410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 --2- 172.21.15.16:0/3883392616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c14103720 0x7f4c14103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 --2- 172.21.15.16:0/3883392616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c14102b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 -- 172.21.15.16:0/3883392616 >> 172.21.15.16:0/3883392616 conn(0x7f4c140fe000 msgr2=0x7f4c141004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 -- 172.21.15.16:0/3883392616 shutdown_connections 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.292+0000 7f4c1a705640 1 -- 172.21.15.16:0/3883392616 wait complete. 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 Processor -- start 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 -- start start 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14103720 0x7f4c1419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c141040c0 0x7f4c141a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1410e2d0 con 0x7f4c14102690 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1410e150 con 0x7f4c14103720 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c1a705640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1410e450 con 0x7f4c141040c0 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43376/0 (socket says 172.21.15.16:43376) 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c13fff640 1 -- 172.21.15.16:0/1193307230 learned_addr learned my addr 172.21.15.16:0/1193307230 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c0bfff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14103720 0x7f4c1419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.293+0000 7f4c18ca2640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c141040c0 0x7f4c141a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 -- 172.21.15.16:0/1193307230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c141040c0 msgr2=0x7f4c141a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c141040c0 0x7f4c141a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 -- 172.21.15.16:0/1193307230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14103720 msgr2=0x7f4c1419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14103720 0x7f4c1419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 -- 172.21.15.16:0/1193307230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c141a1a70 con 0x7f4c14102690 2024-09-21T00:38:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c13fff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c04006010 tx=0x7f4c04004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0403f030 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c141a1d00 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c04003cb0 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035070 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.294+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c141a2180 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.296+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c14109870 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.297+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f4c04042030 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.297+0000 7f4c11ffb640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 0x7f4c000b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.298+0000 7f4c0bfff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 0x7f4c000b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.298+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4c04105c10 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.298+0000 7f4c0bfff640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 0x7f4c000b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc005fd0 tx=0x7f4bfc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.302+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c04003e60 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.493+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f4c14063fc0 con 0x7f4c14102690 2024-09-21T00:38:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.497+0000 7f4c11ffb640 1 -- 172.21.15.16:0/1193307230 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f4c040d2550 con 0x7f4c14102690 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.499+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 msgr2=0x7f4c000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.499+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 0x7f4c000b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc005fd0 tx=0x7f4bfc00b390 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.499+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 msgr2=0x7f4c1406c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.499+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c04006010 tx=0x7f4c04004340 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 shutdown_connections 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4c000b6480 0x7f4c000b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c141040c0 0x7f4c141a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14103720 0x7f4c1419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 --2- 172.21.15.16:0/1193307230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c14102690 0x7f4c1406c060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 >> 172.21.15.16:0/1193307230 conn(0x7f4c140fe000 msgr2=0x7f4c14106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 shutdown_connections 2024-09-21T00:38:09.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:06.500+0000 7f4c1a705640 1 -- 172.21.15.16:0/1193307230 wait complete. 2024-09-21T00:38:09.263 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:38:09.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:09 smithi016 ceph-mon[30947]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:09 smithi123 ceph-mon[34853]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:10.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:09 smithi178 ceph-mon[34888]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 -- 172.21.15.16:0/971294111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 msgr2=0x7f090c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 --2- 172.21.15.16:0/971294111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c103b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0900009900 tx=0x7f090002a480 comp rx=0 tx=0).stop 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 -- 172.21.15.16:0/971294111 shutdown_connections 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 --2- 172.21.15.16:0/971294111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c1040c0 0x7f090c10aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 --2- 172.21.15.16:0/971294111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c103b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 --2- 172.21.15.16:0/971294111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c102690 0x7f090c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 -- 172.21.15.16:0/971294111 >> 172.21.15.16:0/971294111 conn(0x7f090c0fe000 msgr2=0x7f090c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 -- 172.21.15.16:0/971294111 shutdown_connections 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.065+0000 7f0911b5a640 1 -- 172.21.15.16:0/971294111 wait complete. 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 Processor -- start 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 -- start start 2024-09-21T00:38:10.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c1040c0 0x7f090c1a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f090c10e310 con 0x7f090c103720 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f090c10e190 con 0x7f090c102690 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f0911b5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f090c10e490 con 0x7f090c1040c0 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f090affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f090b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f090b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:49330/0 (socket says 172.21.15.16:49330) 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.066+0000 7f090b7fe640 1 -- 172.21.15.16:0/235834204 learned_addr learned my addr 172.21.15.16:0/235834204 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090bfff640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c1040c0 0x7f090c1a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 -- 172.21.15.16:0/235834204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c1040c0 msgr2=0x7f090c1a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c1040c0 0x7f090c1a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 -- 172.21.15.16:0/235834204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 msgr2=0x7f090c06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:10.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 -- 172.21.15.16:0/235834204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c1a1ad0 con 0x7f090c103720 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090b7fe640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f090affd640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c19ed80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f090002aa70 tx=0x7f0900003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090003f070 con 0x7f090c103720 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c1a1d60 con 0x7f090c103720 2024-09-21T00:38:10.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f090003b460 con 0x7f090c103720 2024-09-21T00:38:10.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900035030 con 0x7f090c103720 2024-09-21T00:38:10.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.067+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c1a21c0 con 0x7f090c103720 2024-09-21T00:38:10.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.068+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090c109850 con 0x7f090c103720 2024-09-21T00:38:10.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.070+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f0900042070 con 0x7f090c103720 2024-09-21T00:38:10.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.071+0000 7f0908ff9640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 0x7f08f40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:10.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.071+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0900106590 con 0x7f090c103720 2024-09-21T00:38:10.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.071+0000 7f090b7fe640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 0x7f08f40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:10.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.072+0000 7f090b7fe640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 0x7f08f40b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0058c0 tx=0x7f08fc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:10.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.074+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09000d2ed0 con 0x7f090c103720 2024-09-21T00:38:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.263+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f090c02e840 con 0x7f090c103720 2024-09-21T00:38:10.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.268+0000 7f0908ff9640 1 -- 172.21.15.16:0/235834204 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f09000d7e10 con 0x7f090c103720 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 msgr2=0x7f08f40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 0x7f08f40b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0058c0 tx=0x7f08fc00a380 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 msgr2=0x7f090c19ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c19ed80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f090002aa70 tx=0x7f0900003d50 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 shutdown_connections 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f08f40b6480 0x7f08f40b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090c1040c0 0x7f090c1a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090c103720 0x7f090c19ed80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 --2- 172.21.15.16:0/235834204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090c102690 0x7f090c06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.270+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 >> 172.21.15.16:0/235834204 conn(0x7f090c0fe000 msgr2=0x7f090c106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.271+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 shutdown_connections 2024-09-21T00:38:10.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:10.271+0000 7f0911b5a640 1 -- 172.21.15.16:0/235834204 wait complete. 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.929 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.929 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '49060640-77b1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-21T00:38:10.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T00:38:11.183 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:38:11.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:11 smithi123 ceph-mon[34853]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:11.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:11 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/235834204' entity='client.admin' 2024-09-21T00:38:11.535 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:11 smithi016 ceph-mon[30947]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:11.535 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:11 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/235834204' entity='client.admin' 2024-09-21T00:38:11.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:11 smithi178 ceph-mon[34888]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:11.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:11 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/235834204' entity='client.admin' 2024-09-21T00:38:11.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/2153619255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb4103770 msgr2=0x7f1bb4103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/2153619255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb4103770 0x7f1bb4103be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009900 tx=0x7f1bac02a480 comp rx=0 tx=0).stop 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/2153619255 shutdown_connections 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/2153619255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb41051a0 0x7f1bb410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/2153619255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4104800 0x7f1bb4104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/2153619255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb4103770 0x7f1bb4103be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/2153619255 >> 172.21.15.16:0/2153619255 conn(0x7f1bb40ff0c0 msgr2=0x7f1bb4101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/2153619255 shutdown_connections 2024-09-21T00:38:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.627+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/2153619255 wait complete. 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 Processor -- start 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 -- start start 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4103770 0x7f1bb4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb4104800 0x7f1bb419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb410f3b0 con 0x7f1bb41051a0 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb410f230 con 0x7f1bb4103770 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bbb5d5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb410f530 con 0x7f1bb4104800 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bb9b72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bb9b72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43454/0 (socket says 172.21.15.16:43454) 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bb9b72640 1 -- 172.21.15.16:0/1702710701 learned_addr learned my addr 172.21.15.16:0/1702710701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.628+0000 7f1bb9371640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4103770 0x7f1bb4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb8b70640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb4104800 0x7f1bb419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 -- 172.21.15.16:0/1702710701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb4104800 msgr2=0x7f1bb419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb4104800 0x7f1bb419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 -- 172.21.15.16:0/1702710701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4103770 msgr2=0x7f1bb4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4103770 0x7f1bb4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 -- 172.21.15.16:0/1702710701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb419b9e0 con 0x7f1bb41051a0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb9b72640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400eaa0 tx=0x7f1ba400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400cdb0 con 0x7f1bb41051a0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba4005020 con 0x7f1bb41051a0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb419bcd0 con 0x7f1bb41051a0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40116d0 con 0x7f1bb41051a0 2024-09-21T00:38:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.629+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41a23d0 con 0x7f1bb41051a0 2024-09-21T00:38:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.630+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb410a950 con 0x7f1bb41051a0 2024-09-21T00:38:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.632+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f1ba40051d0 con 0x7f1bb41051a0 2024-09-21T00:38:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.633+0000 7f1bb27fc640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 0x7f1b9c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.633+0000 7f1bb9371640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 0x7f1b9c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.633+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1ba40e5ba0 con 0x7f1bb41051a0 2024-09-21T00:38:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.633+0000 7f1bb9371640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 0x7f1b9c0b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000c00 tx=0x7f1bac031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.636+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ba4016030 con 0x7f1bb41051a0 2024-09-21T00:38:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.828+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1bb402e640 con 0x7f1bb41051a0 2024-09-21T00:38:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.829+0000 7f1bb27fc640 1 -- 172.21.15.16:0/1702710701 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21315 (secure 0 0 0) 0x7f1ba40ae100 con 0x7f1bb41051a0 2024-09-21T00:38:11.830 INFO:teuthology.orchestra.run.smithi016.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global dev auth_debug true 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global basic log_to_file true 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global basic log_to_journald false 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global basic log_to_stderr false 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_allow_pool_delete true 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T00:38:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global dev ms_die_on_bug true 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global dev ms_die_on_old_message true 2024-09-21T00:38:11.832 INFO:teuthology.orchestra.run.smithi016.stdout:global dev ms_die_on_skipped_message false 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced debug_mon 20/20 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced debug_ms 1/1 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced debug_paxos 20/20 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T00:38:11.833 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T00:38:11.834 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced debug_client 20/20 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T00:38:11.835 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev bdev_debug_aio true 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T00:38:11.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced debug_bluefs 20/20 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced debug_bluestore 20/20 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced debug_ms 1/1 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced debug_osd 20/20 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_op_order true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_shutdown true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T00:38:11.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T00:38:11.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced debug_mds 20/20 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced debug_ms 2/2 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T00:38:11.839 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_bal_split_size 100 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds dev mds_debug_frag true 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds dev mds_verify_scatter true 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:client advanced client_mount_timeout 600 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:client advanced debug_client 20/20 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:client advanced debug_ms 1/1 2024-09-21T00:38:11.840 INFO:teuthology.orchestra.run.smithi016.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:38:11.841 INFO:teuthology.orchestra.run.smithi016.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:38:11.841 INFO:teuthology.orchestra.run.smithi016.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T00:38:11.841 INFO:teuthology.orchestra.run.smithi016.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T00:38:11.841 INFO:teuthology.orchestra.run.smithi016.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 msgr2=0x7f1b9c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 0x7f1b9c0b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000c00 tx=0x7f1bac031400 comp rx=0 tx=0).stop 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 msgr2=0x7f1bb419b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400eaa0 tx=0x7f1ba400ef60 comp rx=0 tx=0).stop 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 shutdown_connections 2024-09-21T00:38:11.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1b9c0b6480 0x7f1b9c0b8990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bb41051a0 0x7f1bb419b1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb4104800 0x7f1bb419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 --2- 172.21.15.16:0/1702710701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb4103770 0x7f1bb4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 >> 172.21.15.16:0/1702710701 conn(0x7f1bb40ff0c0 msgr2=0x7f1bb4107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 shutdown_connections 2024-09-21T00:38:11.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:11.831+0000 7f1bbb5d5640 1 -- 172.21.15.16:0/1702710701 wait complete. 2024-09-21T00:38:12.368 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T00:38:12.368 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:38:12.369 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:38:12.386 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:38:12.386 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-21 00:37:00.465658547 +0000 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-21 00:32:32.276040834 +0000 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-21 00:32:32.276040834 +0000 2024-09-21T00:38:12.443 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-21 00:32:32.276040834 +0000 2024-09-21T00:38:12.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:38:12.509 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-21T00:38:12.510 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-21T00:38:12.510 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000111332 s, 4.6 MB/s 2024-09-21T00:38:12.511 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:38:12.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:12 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1702710701' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:38:12.568 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-09-21T00:38:12.625 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:38:12.625 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-21 00:37:00.500658020 +0000 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-21 00:32:32.611035802 +0000 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-21 00:32:32.611035802 +0000 2024-09-21T00:38:12.626 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-21 00:32:32.611035802 +0000 2024-09-21T00:38:12.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:38:12.688 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:12 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1702710701' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:38:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-21T00:38:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-21T00:38:12.691 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000108749 s, 4.7 MB/s 2024-09-21T00:38:12.692 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:38:12.750 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-09-21T00:38:12.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:12 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1702710701' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:38:12.805 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:38:12.805 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-21 00:37:00.534657508 +0000 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-21 00:32:32.941030847 +0000 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-21 00:32:32.941030847 +0000 2024-09-21T00:38:12.806 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-21 00:32:32.941030847 +0000 2024-09-21T00:38:12.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:38:12.870 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-21T00:38:12.870 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-21T00:38:12.870 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000110821 s, 4.6 MB/s 2024-09-21T00:38:12.871 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:38:12.928 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-09-21T00:38:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-21 00:37:00.572656936 +0000 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-21 00:32:33.268025935 +0000 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-21 00:32:33.268025935 +0000 2024-09-21T00:38:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-21 00:32:33.268025935 +0000 2024-09-21T00:38:12.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:38:13.049 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-21T00:38:13.049 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-21T00:38:13.049 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000111765 s, 4.6 MB/s 2024-09-21T00:38:13.051 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:38:13.108 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T00:38:13.108 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:38:13.127 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:38:13.128 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-21T00:38:13.186 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:38:13.186 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:13.186 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 00:37:47.683902611 +0000 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 00:32:37.473446668 +0000 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 00:32:37.473446668 +0000 2024-09-21T00:38:13.187 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 00:32:37.473446668 +0000 2024-09-21T00:38:13.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:38:13.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T00:38:13.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T00:38:13.257 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000289121 s, 1.8 MB/s 2024-09-21T00:38:13.258 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:38:13.317 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 00:37:47.683902611 +0000 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 00:32:37.793438994 +0000 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 00:32:37.793438994 +0000 2024-09-21T00:38:13.374 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 00:32:37.793438994 +0000 2024-09-21T00:38:13.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:38:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T00:38:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T00:38:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000207886 s, 2.5 MB/s 2024-09-21T00:38:13.441 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:38:13.497 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-21T00:38:13.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:13 smithi016 ceph-mon[30947]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:13 smithi123 ceph-mon[34853]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 00:37:47.684902587 +0000 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 00:32:38.130430913 +0000 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 00:32:38.130430913 +0000 2024-09-21T00:38:13.535 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 00:32:38.130430913 +0000 2024-09-21T00:38:13.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:38:13.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:13 smithi178 ceph-mon[34888]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T00:38:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T00:38:13.600 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000204884 s, 2.5 MB/s 2024-09-21T00:38:13.601 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:38:13.657 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 00:37:47.684902587 +0000 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 00:32:38.458423047 +0000 2024-09-21T00:38:13.713 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 00:32:38.458423047 +0000 2024-09-21T00:38:13.714 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 00:32:38.458423047 +0000 2024-09-21T00:38:13.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:38:13.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T00:38:13.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T00:38:13.777 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000218211 s, 2.3 MB/s 2024-09-21T00:38:13.778 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:38:13.834 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-21T00:38:13.834 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:38:13.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:38:13.854 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-21T00:38:13.913 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 00:37:45.355791604 +0000 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 00:32:36.335302726 +0000 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 00:32:36.335302726 +0000 2024-09-21T00:38:13.914 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 00:32:36.335302726 +0000 2024-09-21T00:38:13.914 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:38:13.984 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T00:38:13.985 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T00:38:13.985 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000129589 s, 4.0 MB/s 2024-09-21T00:38:13.986 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:38:14.045 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-21T00:38:14.105 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 00:37:45.356791586 +0000 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 00:32:36.641297132 +0000 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 00:32:36.641297132 +0000 2024-09-21T00:38:14.106 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 00:32:36.641297132 +0000 2024-09-21T00:38:14.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:38:14.174 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T00:38:14.174 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T00:38:14.174 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000133499 s, 3.8 MB/s 2024-09-21T00:38:14.175 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:38:14.235 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 00:37:45.356791586 +0000 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 00:32:36.946291555 +0000 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 00:32:36.946291555 +0000 2024-09-21T00:38:14.294 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 00:32:36.946291555 +0000 2024-09-21T00:38:14.295 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:38:14.362 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T00:38:14.362 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T00:38:14.362 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000131991 s, 3.9 MB/s 2024-09-21T00:38:14.363 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:38:14.422 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-21T00:38:14.480 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-21 00:37:45.356791586 +0000 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-21 00:32:37.250285998 +0000 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-21 00:32:37.250285998 +0000 2024-09-21T00:38:14.481 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-21 00:32:37.250285998 +0000 2024-09-21T00:38:14.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:38:14.547 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-21T00:38:14.548 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-21T00:38:14.548 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000125809 s, 4.1 MB/s 2024-09-21T00:38:14.549 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:38:14.608 INFO:tasks.cephadm:Deploying osd.0 on smithi016 with /dev/vg_nvme/lv_4... 2024-09-21T00:38:14.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:38:14.872 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:38:15.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:15 smithi178 ceph-mon[34888]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:15.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:15 smithi016 ceph-mon[30947]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:15.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:15 smithi123 ceph-mon[34853]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:38:17.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2024-09-21T00:38:17.494 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:38:17.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:17 smithi178 ceph-mon[34888]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:17.611 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:17 smithi016 ceph-mon[30947]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:17 smithi123 ceph-mon[34853]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 -- 172.21.15.16:0/3711564802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 msgr2=0x7f5e8c10dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/3711564802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c10dbc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009ca0 tx=0x7f5e8402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 -- 172.21.15.16:0/3711564802 shutdown_connections 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/3711564802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c10dbc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/3711564802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c108d00 0x7f5e8c10b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/3711564802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c06c490 0x7f5e8c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 -- 172.21.15.16:0/3711564802 >> 172.21.15.16:0/3711564802 conn(0x7f5e8c0fdfe0 msgr2=0x7f5e8c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 -- 172.21.15.16:0/3711564802 shutdown_connections 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 -- 172.21.15.16:0/3711564802 wait complete. 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.958+0000 7f5e93aa0640 1 Processor -- start 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 -- start start 2024-09-21T00:38:17.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c06c490 0x7f5e8c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c108d00 0x7f5e8c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c1115c0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c111440 con 0x7f5e8c06c490 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e93aa0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c111740 con 0x7f5e8c108d00 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43008/0 (socket says 172.21.15.16:43008) 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 -- 172.21.15.16:0/1709694932 learned_addr learned my addr 172.21.15.16:0/1709694932 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9103b640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c108d00 0x7f5e8c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9183c640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c06c490 0x7f5e8c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 -- 172.21.15.16:0/1709694932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c108d00 msgr2=0x7f5e8c19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c108d00 0x7f5e8c19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 -- 172.21.15.16:0/1709694932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c06c490 msgr2=0x7f5e8c19c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c06c490 0x7f5e8c19c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 -- 172.21.15.16:0/1709694932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8c19dbb0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.959+0000 7f5e9203d640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e840097b0 tx=0x7f5e84003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.960+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84004240 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.960+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e840317c0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.960+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8c19de40 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.960+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8402fde0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.960+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8c1a45a0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.961+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8c0ffb00 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.963+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f5e840043e0 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.964+0000 7f5e82ffd640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 0x7f5e780b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.964+0000 7f5e9183c640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 0x7f5e780b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.964+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5e84107130 con 0x7f5e8c10b6b0 2024-09-21T00:38:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.965+0000 7f5e9183c640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 0x7f5e780b8990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e88005fd0 tx=0x7f5e88005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:17.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:17.967+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e840cf690 con 0x7f5e8c10b6b0 2024-09-21T00:38:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:18.168+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5e8c063800 con 0x7f5e780b6480 2024-09-21T00:38:18.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:18.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:18.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:18.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:18.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:18.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:18.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:18.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:18.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:19.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:19 smithi178 ceph-mon[34888]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:19.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:19 smithi178 ceph-mon[34888]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:19.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:19 smithi016 ceph-mon[30947]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:19.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:19 smithi016 ceph-mon[30947]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:19 smithi123 ceph-mon[34853]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:19 smithi123 ceph-mon[34853]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:21.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:21.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"} : dispatch 2024-09-21T00:38:21.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"}]': finished 2024-09-21T00:38:21.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:38:21.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:21.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1167312451' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"} : dispatch 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"}]': finished 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1167312451' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"} : dispatch 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2071559490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5583349e-c367-4589-b3a7-a3912bb27cec"}]': finished 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1167312451' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:23.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:23 smithi016 ceph-mon[30947]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:23.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:23 smithi123 ceph-mon[34853]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:23.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:23 smithi178 ceph-mon[34888]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:25.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:25 smithi016 ceph-mon[30947]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:25 smithi123 ceph-mon[34853]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:25 smithi178 ceph-mon[34888]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:27.641 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:27 smithi016 ceph-mon[30947]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:27 smithi123 ceph-mon[34853]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:27 smithi178 ceph-mon[34888]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:29 smithi016 ceph-mon[30947]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:38:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:29 smithi016 ceph-mon[30947]: Deploying daemon osd.0 on smithi016 2024-09-21T00:38:29.572 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:29 smithi123 ceph-mon[34853]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:29.572 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:38:29.573 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:29.573 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:29 smithi123 ceph-mon[34853]: Deploying daemon osd.0 on smithi016 2024-09-21T00:38:29.589 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:29 smithi178 ceph-mon[34888]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:29.589 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:38:29.589 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:29.590 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:29 smithi178 ceph-mon[34888]: Deploying daemon osd.0 on smithi016 2024-09-21T00:38:31.727 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:31 smithi016 ceph-mon[30947]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:31.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:31 smithi123 ceph-mon[34853]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:31.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:31 smithi178 ceph-mon[34888]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:33.703 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:33 smithi016 ceph-mon[30947]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:33.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:33 smithi123 ceph-mon[34853]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:33.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:33 smithi178 ceph-mon[34888]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:35.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:35 smithi016 ceph-mon[30947]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:35.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:35.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:35.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:35 smithi123 ceph-mon[34853]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:35.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:35 smithi178 ceph-mon[34888]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:35.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:35.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:35.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:37.533 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:37 smithi016 ceph-mon[30947]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:37.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:37 smithi123 ceph-mon[34853]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:37.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:37 smithi178 ceph-mon[34888]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:39.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:39.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:39.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:39.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:39.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:39.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:39.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:39.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.371+0000 7f5e82ffd640 1 -- 172.21.15.16:0/1709694932 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e8c063800 con 0x7f5e780b6480 2024-09-21T00:38:39.372 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 0 on host 'smithi016' 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 msgr2=0x7f5e780b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 0x7f5e780b8990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e88005fd0 tx=0x7f5e88005e20 comp rx=0 tx=0).stop 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 msgr2=0x7f5e8c19d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e840097b0 tx=0x7f5e84003c20 comp rx=0 tx=0).stop 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 shutdown_connections 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5e780b6480 0x7f5e780b8990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8c10b6b0 0x7f5e8c19d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e8c108d00 0x7f5e8c19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 --2- 172.21.15.16:0/1709694932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8c06c490 0x7f5e8c19c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 >> 172.21.15.16:0/1709694932 conn(0x7f5e8c0fdfe0 msgr2=0x7f5e8c109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 shutdown_connections 2024-09-21T00:38:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:38:39.374+0000 7f5e93aa0640 1 -- 172.21.15.16:0/1709694932 wait complete. 2024-09-21T00:38:40.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:39 smithi016 ceph-mon[30947]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:40.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:40.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:39 smithi123 ceph-mon[34853]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:39 smithi178 ceph-mon[34888]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:40.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:38:40.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:40.038 DEBUG:teuthology.orchestra.run.smithi016:osd.0> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T00:38:40.040 INFO:tasks.cephadm:Deploying osd.1 on smithi123 with /dev/vg_nvme/lv_4... 2024-09-21T00:38:40.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:38:40.288 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:38:41.509 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:38:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:38:41.281+0000 7fd543899640 -1 osd.0 0 log_to_monitors true 2024-09-21T00:38:41.861 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:41 smithi123 ceph-mon[34853]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:41.861 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:41 smithi123 ceph-mon[34853]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:38:42.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:41 smithi178 ceph-mon[34888]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:42.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:41 smithi178 ceph-mon[34888]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:38:42.196 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:41 smithi016 ceph-mon[30947]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:42.196 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:41 smithi016 ceph-mon[30947]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:38:42.725 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:38:42.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-09-21T00:38:43.006 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:38:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:42 smithi123 ceph-mon[34853]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:43.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:43.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:38:43.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:42 smithi178 ceph-mon[34888]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:38:43.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:38:43.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:38:43.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:42 smithi016 ceph-mon[30947]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 -- 172.21.15.123:0/3293689458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 msgr2=0x7f0fa4104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 --2- 172.21.15.123:0/3293689458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa4104bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02a480 comp rx=0 tx=0).stop 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 -- 172.21.15.123:0/3293689458 shutdown_connections 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 --2- 172.21.15.123:0/3293689458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4105180 0x7f0fa410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 --2- 172.21.15.123:0/3293689458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa4104bf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 --2- 172.21.15.123:0/3293689458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4103750 0x7f0fa4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:43.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 -- 172.21.15.123:0/3293689458 >> 172.21.15.123:0/3293689458 conn(0x7f0fa40ff0e0 msgr2=0x7f0fa4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 -- 172.21.15.123:0/3293689458 shutdown_connections 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.468+0000 7f0fa9392640 1 -- 172.21.15.123:0/3293689458 wait complete. 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 Processor -- start 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 -- start start 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4103750 0x7f0fa419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4105180 0x7f0fa419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa410f3f0 con 0x7f0fa4105180 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa410f270 con 0x7f0fa41047e0 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.469+0000 7f0fa9392640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa410f570 con 0x7f0fa4103750 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49766/0 (socket says 172.21.15.123:49766) 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 -- 172.21.15.123:0/1789363072 learned_addr learned my addr 172.21.15.123:0/1789363072 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa2ffd640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4103750 0x7f0fa419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:43.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa37fe640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4105180 0x7f0fa419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 -- 172.21.15.123:0/1789363072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4103750 msgr2=0x7f0fa419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4103750 0x7f0fa419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 -- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4105180 msgr2=0x7f0fa419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4105180 0x7f0fa419b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 -- 172.21.15.123:0/1789363072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa419ba40 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa27fc640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c031440 tx=0x7f0f8c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c03f070 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f8c031c50 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa419bcd0 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c035030 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.470+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa41a2260 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.471+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa410a910 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.473+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f0f8c042070 con 0x7f0fa41047e0 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.473+0000 7f0f9bfff640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 0x7f0f900b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:38:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.474+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f0f8c1067f0 con 0x7f0fa41047e0 2024-09-21T00:38:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.474+0000 7f0fa2ffd640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 0x7f0f900b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:38:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.474+0000 7f0fa2ffd640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 0x7f0f900b8990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f94005d00 tx=0x7f0f94005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:38:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.477+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f8c0cec10 con 0x7f0fa41047e0 2024-09-21T00:38:43.509 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:38:43.213+0000 7fd53f81b640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T00:38:43.509 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:38:43.216+0000 7fd537611640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:38:43.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:38:43.662+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0fa4063800 con 0x7f0f900b6480 2024-09-21T00:38:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi016 2024-09-21T00:38:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-21T00:38:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:44.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi016 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:44.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:44.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:44.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi016 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246]' entity='osd.0' 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:44.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:44.814 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:38:44.814 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:38:44.814 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:44.814 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] boot 2024-09-21T00:38:44.815 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:38:44.815 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:45.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:38:45.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:38:45.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:45.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] boot 2024-09-21T00:38:45.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:38:45.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: osd.0 [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] boot 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:38:45.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:38:46.047 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:45 smithi123 ceph-mon[34853]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:46.047 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:45 smithi123 ceph-mon[34853]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:38:46.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:45 smithi016 ceph-mon[30947]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:46.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:45 smithi016 ceph-mon[30947]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:38:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:45 smithi178 ceph-mon[34888]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:38:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:45 smithi178 ceph-mon[34888]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/3114726337' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"}]': finished 2024-09-21T00:38:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:38:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:38:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:46 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/340891645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/3114726337' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"}]': finished 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:38:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:46 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/340891645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/3114726337' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"} : dispatch 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "999bcbd3-bb63-4e7c-b2e7-e41b2fb218df"}]': finished 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:38:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:46 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/340891645' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:47 smithi016 ceph-mon[30947]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:47 smithi123 ceph-mon[34853]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:47 smithi178 ceph-mon[34888]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:49 smithi016 ceph-mon[30947]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:49 smithi123 ceph-mon[34853]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:49 smithi178 ceph-mon[34888]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:52.017 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:51 smithi123 ceph-mon[34853]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:52.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:51 smithi016 ceph-mon[30947]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:51 smithi178 ceph-mon[34888]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:54.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:53 smithi123 ceph-mon[34853]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:53 smithi016 ceph-mon[30947]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:54.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:53 smithi178 ceph-mon[34888]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:55.108 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:54 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:38:55.108 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:54 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:55.108 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:54 smithi123 ceph-mon[34853]: Deploying daemon osd.1 on smithi123 2024-09-21T00:38:55.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:54 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:38:55.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:54 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:55.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:54 smithi016 ceph-mon[30947]: Deploying daemon osd.1 on smithi123 2024-09-21T00:38:55.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:54 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:38:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:54 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:38:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:54 smithi178 ceph-mon[34888]: Deploying daemon osd.1 on smithi123 2024-09-21T00:38:55.985 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:55 smithi123 ceph-mon[34853]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:56.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:55 smithi016 ceph-mon[30947]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:56.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:55 smithi178 ceph-mon[34888]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:58.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:57 smithi016 ceph-mon[30947]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:58.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:57 smithi123 ceph-mon[34853]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:38:58.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:57 smithi178 ceph-mon[34888]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:00.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:38:59 smithi123 ceph-mon[34853]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:00.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:38:59 smithi016 ceph-mon[30947]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:00.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:38:59 smithi178 ceph-mon[34888]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:00.995 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:00.995 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:00.995 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:01.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:01.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:01.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:01.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:01.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:01.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:02.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:01 smithi016 ceph-mon[30947]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:02.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:01 smithi123 ceph-mon[34853]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:02.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:01 smithi178 ceph-mon[34888]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:03.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:03 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:03.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:03 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:03 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.358 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 1 on host 'smithi123' 2024-09-21T00:39:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.357+0000 7f0f9bfff640 1 -- 172.21.15.123:0/1789363072 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0fa4063800 con 0x7f0f900b6480 2024-09-21T00:39:04.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 msgr2=0x7f0f900b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:04.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 0x7f0f900b8990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f94005d00 tx=0x7f0f94005c50 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 msgr2=0x7f0fa419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c031440 tx=0x7f0f8c003c10 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 shutdown_connections 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6480 0x7f0f900b8990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa4105180 0x7f0fa419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa41047e0 0x7f0fa419a680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 --2- 172.21.15.123:0/1789363072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa4103750 0x7f0fa419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 >> 172.21.15.123:0/1789363072 conn(0x7f0fa40ff0e0 msgr2=0x7f0fa4107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 shutdown_connections 2024-09-21T00:39:04.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:04.360+0000 7f0fa9392640 1 -- 172.21.15.123:0/1789363072 wait complete. 2024-09-21T00:39:04.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:04.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:04.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:04.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:05.003 DEBUG:teuthology.orchestra.run.smithi123:osd.1> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T00:39:05.006 INFO:tasks.cephadm:Deploying osd.2 on smithi178 with /dev/vg_nvme/lv_4... 2024-09-21T00:39:05.006 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:39:05.256 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:39:05.649 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:05 smithi178 ceph-mon[34888]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:05.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:05 smithi016 ceph-mon[30947]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:05.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:05 smithi123 ceph-mon[34853]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:07.021 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:39:06.577+0000 7f1121f12640 -1 osd.1 0 log_to_monitors true 2024-09-21T00:39:07.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:07 smithi178 ceph-mon[34888]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:07.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:07 smithi178 ceph-mon[34888]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:07.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:07 smithi178 ceph-mon[34888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:07 smithi016 ceph-mon[30947]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:07 smithi016 ceph-mon[30947]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:07 smithi016 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:07 smithi123 ceph-mon[34853]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:07 smithi123 ceph-mon[34853]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:07.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:07 smithi123 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:39:08.019 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:39:08.050 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2024-09-21T00:39:08.302 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:39:08.560 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi123 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi123 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:08.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:08.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:39:08.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi123 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:08.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 -- 172.21.15.178:0/2687337438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358103770 msgr2=0x7f1358103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 --2- 172.21.15.178:0/2687337438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358103770 0x7f1358103be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1348009900 tx=0x7f134802a480 comp rx=0 tx=0).stop 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 -- 172.21.15.178:0/2687337438 shutdown_connections 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 --2- 172.21.15.178:0/2687337438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 0x7f135810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 --2- 172.21.15.178:0/2687337438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358104800 0x7f1358104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:08.793 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 --2- 172.21.15.178:0/2687337438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358103770 0x7f1358103be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:08.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 -- 172.21.15.178:0/2687337438 >> 172.21.15.178:0/2687337438 conn(0x7f13580ff0c0 msgr2=0x7f1358101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:08.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 -- 172.21.15.178:0/2687337438 shutdown_connections 2024-09-21T00:39:08.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 -- 172.21.15.178:0/2687337438 wait complete. 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.792+0000 7f135ed6f640 1 Processor -- start 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 -- start start 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358103770 0x7f1358199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 0x7f135819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f390 con 0x7f13581051a0 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f210 con 0x7f1358103770 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135ed6f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f135810f510 con 0x7f1358104800 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:08.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:35244/0 (socket says 172.21.15.178:35244) 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 -- 172.21.15.178:0/901833966 learned_addr learned my addr 172.21.15.178:0/901833966 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135cb0b640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358103770 0x7f1358199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f135d30c640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 0x7f135819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 -- 172.21.15.178:0/901833966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358103770 msgr2=0x7f1358199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358103770 0x7f1358199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 -- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 msgr2=0x7f135819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 0x7f135819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 -- 172.21.15.178:0/901833966 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135819b9f0 con 0x7f1358104800 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.793+0000 7f1357fff640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d950 tx=0x7f134c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.794+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c017030 con 0x7f1358104800 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.794+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135819bce0 con 0x7f1358104800 2024-09-21T00:39:08.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.794+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f134c004020 con 0x7f1358104800 2024-09-21T00:39:08.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.794+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c0047a0 con 0x7f1358104800 2024-09-21T00:39:08.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.794+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13581a23e0 con 0x7f1358104800 2024-09-21T00:39:08.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.795+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135810a950 con 0x7f1358104800 2024-09-21T00:39:08.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.796+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f134c009a30 con 0x7f1358104800 2024-09-21T00:39:08.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.797+0000 7f1355ffb640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 0x7f13400b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:08.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.797+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f134c0e5490 con 0x7f1358104800 2024-09-21T00:39:08.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.797+0000 7f135cb0b640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 0x7f13400b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:08.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.798+0000 7f135cb0b640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 0x7f13400b8990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1348000c00 tx=0x7f1348031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:08.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.801+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f134c0ad690 con 0x7f1358104800 2024-09-21T00:39:08.990 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:08.989+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1358063800 con 0x7f13400b6480 2024-09-21T00:39:09.270 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:39:08.974+0000 7f111de94640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T00:39:09.270 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:08 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:39:08.977+0000 7f1115c8a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:39:09.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:09.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:39:09.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:39:09.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:09.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:09.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='osd.1 ' entity='osd.1' 2024-09-21T00:39:09.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:09.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:09.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:09.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='osd.1 ' entity='osd.1' 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:09.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:10.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='osd.1 ' entity='osd.1' 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:10.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] boot 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:39:10.693 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:10 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:39:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:39:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] boot 2024-09-21T00:39:10.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:39:10.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:10 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: osd.1 [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] boot 2024-09-21T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:10 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:39:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/3110290370' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:11.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"}]': finished 2024-09-21T00:39:11.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T00:39:11.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/3110290370' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"}]': finished 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T00:39:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/3110290370' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"} : dispatch 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b09b9ef0-4e02-4df8-9e16-876c52c027c5"}]': finished 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T00:39:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:12.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:12 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/3725620360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:12 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/3725620360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:13.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:12 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/3725620360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:13.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:13 smithi178 ceph-mon[34888]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:14.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:13 smithi016 ceph-mon[30947]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:13 smithi123 ceph-mon[34853]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:15.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:15 smithi178 ceph-mon[34888]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:16.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:15 smithi016 ceph-mon[30947]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:15 smithi123 ceph-mon[34853]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:17.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:17 smithi178 ceph-mon[34888]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:18.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:17 smithi016 ceph-mon[30947]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:17 smithi123 ceph-mon[34853]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:19.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:19 smithi178 ceph-mon[34888]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:19 smithi016 ceph-mon[30947]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:19 smithi123 ceph-mon[34853]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:20.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:39:20.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:20.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:20 smithi178 ceph-mon[34888]: Deploying daemon osd.2 on smithi178 2024-09-21T00:39:21.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:39:21.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:21.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:20 smithi016 ceph-mon[30947]: Deploying daemon osd.2 on smithi178 2024-09-21T00:39:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:39:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:20 smithi123 ceph-mon[34853]: Deploying daemon osd.2 on smithi178 2024-09-21T00:39:21.655 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:21 smithi178 ceph-mon[34888]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:21 smithi016 ceph-mon[30947]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:21 smithi123 ceph-mon[34853]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:24.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:23 smithi016 ceph-mon[30947]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:24.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:23 smithi123 ceph-mon[34853]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:24.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:23 smithi178 ceph-mon[34888]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:25.743 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:25 smithi178 ceph-mon[34888]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:25 smithi016 ceph-mon[30947]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:25 smithi123 ceph-mon[34853]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:26.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:26.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:26.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:27.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:27.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:27.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:27.995 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:27 smithi178 ceph-mon[34888]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:27 smithi016 ceph-mon[30947]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:27 smithi123 ceph-mon[34853]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:29.481 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:29.481 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.481 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:29.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:29.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:29.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.814+0000 7f1355ffb640 1 -- 172.21.15.178:0/901833966 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1358063800 con 0x7f13400b6480 2024-09-21T00:39:29.816 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 2 on host 'smithi178' 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 msgr2=0x7f13400b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 0x7f13400b8990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1348000c00 tx=0x7f1348031400 comp rx=0 tx=0).stop 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 msgr2=0x7f135819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d950 tx=0x7f134c00de10 comp rx=0 tx=0).stop 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 shutdown_connections 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f13400b6480 0x7f13400b8990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13581051a0 0x7f135819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1358104800 0x7f135819a630 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:29.819 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 --2- 172.21.15.178:0/901833966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1358103770 0x7f1358199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:29.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 >> 172.21.15.178:0/901833966 conn(0x7f13580ff0c0 msgr2=0x7f1358107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:29.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 shutdown_connections 2024-09-21T00:39:29.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:39:29.817+0000 7f135ed6f640 1 -- 172.21.15.178:0/901833966 wait complete. 2024-09-21T00:39:30.402 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:30.402 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.402 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.429 DEBUG:teuthology.orchestra.run.smithi178:osd.2> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T00:39:30.431 INFO:tasks.cephadm:Deploying osd.3 on smithi016 with /dev/vg_nvme/lv_3... 2024-09-21T00:39:30.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:39:30.460 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:30.460 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.460 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:30.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:30.698 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:39:32.011 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:31 smithi178 ceph-mon[34888]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:32.012 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:39:31.957+0000 7f93e6717640 -1 osd.2 0 log_to_monitors true 2024-09-21T00:39:32.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:31 smithi016 ceph-mon[30947]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:32.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:31 smithi123 ceph-mon[34853]: pgmap v86: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:33.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:32 smithi016 ceph-mon[30947]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:32 smithi016 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:32 smithi178 ceph-mon[34888]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:32 smithi178 ceph-mon[34888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:32 smithi123 ceph-mon[34853]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:32 smithi123 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:39:33.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:39:33.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2024-09-21T00:39:33.678 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:39:33.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:33.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:39:33.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:39:33.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:33.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 -- 172.21.15.16:0/3981069872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 msgr2=0x7fa918102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 --2- 172.21.15.16:0/3981069872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa918102ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa908009900 tx=0x7fa90802a480 comp rx=0 tx=0).stop 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 -- 172.21.15.16:0/3981069872 shutdown_connections 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 --2- 172.21.15.16:0/3981069872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 0x7fa91810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 --2- 172.21.15.16:0/3981069872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 0x7fa918103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 --2- 172.21.15.16:0/3981069872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa918102ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 -- 172.21.15.16:0/3981069872 >> 172.21.15.16:0/3981069872 conn(0x7fa9180fdfb0 msgr2=0x7fa918100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 -- 172.21.15.16:0/3981069872 shutdown_connections 2024-09-21T00:39:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.176+0000 7fa91e255640 1 -- 172.21.15.16:0/3981069872 wait complete. 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.177+0000 7fa91e255640 1 Processor -- start 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.177+0000 7fa91e255640 1 -- start start 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 0x7fa91810d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 0x7fa91810dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa91806b9f0 con 0x7fa918102640 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa91806b870 con 0x7fa9181036d0 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa91e255640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa91806bb70 con 0x7fa918104070 2024-09-21T00:39:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46488/0 (socket says 172.21.15.16:46488) 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 -- 172.21.15.16:0/1114950281 learned_addr learned my addr 172.21.15.16:0/1114950281 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa917fff640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 0x7fa91810dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa916ffd640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 0x7fa91810d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 -- 172.21.15.16:0/1114950281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 msgr2=0x7fa91810dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 0x7fa91810dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 -- 172.21.15.16:0/1114950281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 msgr2=0x7fa91810d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 0x7fa91810d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 -- 172.21.15.16:0/1114950281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91810e450 con 0x7fa918102640 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.178+0000 7fa9177fe640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa908006010 tx=0x7fa908031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.179+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90803f030 con 0x7fa918102640 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.179+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa908003aa0 con 0x7fa918102640 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.179+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908035070 con 0x7fa918102640 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.179+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9181a4040 con 0x7fa918102640 2024-09-21T00:39:34.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.179+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9181a43e0 con 0x7fa918102640 2024-09-21T00:39:34.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.180+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa918109820 con 0x7fa918102640 2024-09-21T00:39:34.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.181+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fa908042030 con 0x7fa918102640 2024-09-21T00:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.183+0000 7fa914ff9640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 0x7fa9000b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.183+0000 7fa916ffd640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 0x7fa9000b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.183+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fa908106800 con 0x7fa918102640 2024-09-21T00:39:34.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.183+0000 7fa916ffd640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 0x7fa9000b8990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00bbe0 tx=0x7fa90c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.186+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9080d2b60 con 0x7fa918102640 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:34.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:34.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:34.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: pgmap v87: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:39:34.281 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:34.282 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:34.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:34.385+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa918063800 con 0x7fa9000b6480 2024-09-21T00:39:34.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:39:34.278+0000 7f93e2699640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T00:39:34.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:39:34.282+0000 7f93da48f640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:39:35.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi178 2024-09-21T00:39:35.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-21T00:39:35.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:39:35.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='osd.2 ' entity='osd.2' 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:35.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:35.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi178 2024-09-21T00:39:35.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-21T00:39:35.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:39:35.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='osd.2 ' entity='osd.2' 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:35.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi178 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='osd.2 ' entity='osd.2' 2024-09-21T00:39:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:39:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:39:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:36.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:39:36.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] boot 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T00:39:36.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:39:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:39:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] boot 2024-09-21T00:39:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T00:39:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: pgmap v90: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: osd.2 [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] boot 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T00:39:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:39:37.005 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:37.089 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:37.089 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.090 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.090 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.090 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43082]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51030]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51030]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51030]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51033]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51033]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.114 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:39:36 smithi016 sudo[51033]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42326]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42329]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42320]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.271 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:39:37 smithi123 sudo[42323]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.494 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51042]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.494 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51042]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51042]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.495 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 sudo[51045]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43085]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43088]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:39:37.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 sudo[43091]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: pgmap v92: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"} : dispatch 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"}]': finished 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:37 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3010399303' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: pgmap v92: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:39:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"} : dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"}]': finished 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:37 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3010399303' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: pgmap v92: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"} : dispatch 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:39:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1090097095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda541c6-f1c3-40b9-8101-307d46151404"}]': finished 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:39:38.289 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:37 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3010399303' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:39:38.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:38.891+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa9080ca3a0 con 0x7fa918102640 2024-09-21T00:39:39.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:38 smithi016 ceph-mon[30947]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:39:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:39.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:38 smithi123 ceph-mon[34853]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:39:39.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:39.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:38 smithi178 ceph-mon[34888]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:39:39.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:40.252 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:39 smithi123 ceph-mon[34853]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:40.253 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:39 smithi123 ceph-mon[34853]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:39:40.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:39 smithi016 ceph-mon[30947]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:40.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:39 smithi016 ceph-mon[30947]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:39:40.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:39 smithi178 ceph-mon[34888]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:40.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:39 smithi178 ceph-mon[34888]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:39:42.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:41 smithi016 ceph-mon[30947]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:42.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:41 smithi123 ceph-mon[34853]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:42.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:41 smithi178 ceph-mon[34888]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:44.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:43 smithi016 ceph-mon[30947]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:44.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:43 smithi123 ceph-mon[34853]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:44.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:43 smithi178 ceph-mon[34888]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:45.947 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:45 smithi016 ceph-mon[30947]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:45.947 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:39:45.948 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:45 smithi123 ceph-mon[34853]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:39:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:45 smithi178 ceph-mon[34888]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:39:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:46 smithi016 ceph-mon[30947]: Deploying daemon osd.3 on smithi016 2024-09-21T00:39:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:46 smithi123 ceph-mon[34853]: Deploying daemon osd.3 on smithi016 2024-09-21T00:39:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:46 smithi178 ceph-mon[34888]: Deploying daemon osd.3 on smithi016 2024-09-21T00:39:48.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:47 smithi016 ceph-mon[30947]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:47 smithi123 ceph-mon[34853]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:48.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:47 smithi178 ceph-mon[34888]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:50.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:49 smithi016 ceph-mon[30947]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:49 smithi123 ceph-mon[34853]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:49 smithi178 ceph-mon[34888]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:52.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:51 smithi016 ceph-mon[30947]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:52.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:52.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:52.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:51 smithi123 ceph-mon[34853]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:51 smithi178 ceph-mon[34888]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:53 smithi016 ceph-mon[30947]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:54.426 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:53 smithi178 ceph-mon[34888]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:54.426 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:53 smithi123 ceph-mon[34853]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:55.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.428+0000 7fa914ff9640 1 -- 172.21.15.16:0/1114950281 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa918063800 con 0x7fa9000b6480 2024-09-21T00:39:55.429 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 3 on host 'smithi016' 2024-09-21T00:39:55.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 msgr2=0x7fa9000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:55.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 0x7fa9000b8990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00bbe0 tx=0x7fa90c00b390 comp rx=0 tx=0).stop 2024-09-21T00:39:55.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 msgr2=0x7fa91810ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:55.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa908006010 tx=0x7fa908031a50 comp rx=0 tx=0).stop 2024-09-21T00:39:55.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 shutdown_connections 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa9000b6480 0x7fa9000b8990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa918104070 0x7fa91810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9181036d0 0x7fa91810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 --2- 172.21.15.16:0/1114950281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa918102640 0x7fa91810ef40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 >> 172.21.15.16:0/1114950281 conn(0x7fa9180fdfb0 msgr2=0x7fa9181069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 shutdown_connections 2024-09-21T00:39:55.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:39:55.431+0000 7fa91e255640 1 -- 172.21.15.16:0/1114950281 wait complete. 2024-09-21T00:39:55.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:55.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:55.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:55.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:55.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.053 DEBUG:teuthology.orchestra.run.smithi016:osd.3> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T00:39:56.056 INFO:tasks.cephadm:Deploying osd.4 on smithi123 with /dev/vg_nvme/lv_3... 2024-09-21T00:39:56.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:39:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:39:56.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:56 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:56.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:56 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:56 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.681 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:56 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:56.682 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:56 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.682 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:56 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:56 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:39:56.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:56 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:56.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:56 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:57.506 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:57 smithi016 ceph-mon[30947]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:57.694 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:57 smithi123 ceph-mon[34853]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:57.759 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:39:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:39:57.715+0000 7f99f3548640 -1 osd.3 0 log_to_monitors true 2024-09-21T00:39:57.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:57 smithi178 ceph-mon[34888]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:58.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:58 smithi016 ceph-mon[30947]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:39:58.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:58 smithi123 ceph-mon[34853]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:39:58.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:58 smithi178 ceph-mon[34888]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:39:58.938 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:39:58.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-09-21T00:39:59.210 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi016 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.526 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:59.527 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:39:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 -- 172.21.15.123:0/3485365737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 msgr2=0x7f83a8103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 --2- 172.21.15.123:0/3485365737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a8103af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f839c009900 tx=0x7f839c02a480 comp rx=0 tx=0).stop 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 -- 172.21.15.123:0/3485365737 shutdown_connections 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 --2- 172.21.15.123:0/3485365737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83a8104080 0x7f83a810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 --2- 172.21.15.123:0/3485365737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a8103af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 --2- 172.21.15.123:0/3485365737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 0x7f83a8102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 -- 172.21.15.123:0/3485365737 >> 172.21.15.123:0/3485365737 conn(0x7f83a80fdfe0 msgr2=0x7f83a8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 -- 172.21.15.123:0/3485365737 shutdown_connections 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.747+0000 7f83adcac640 1 -- 172.21.15.123:0/3485365737 wait complete. 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 Processor -- start 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 -- start start 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 0x7f83a819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83a8104080 0x7f83a819b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f83a810e300 con 0x7f83a8102650 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83a810e180 con 0x7f83a81036e0 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83adcac640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f83a810e480 con 0x7f83a8104080 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44840/0 (socket says 172.21.15.123:44840) 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 -- 172.21.15.123:0/3545480812 learned_addr learned my addr 172.21.15.123:0/3545480812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a77fe640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 0x7f83a819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 -- 172.21.15.123:0/3545480812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83a8104080 msgr2=0x7f83a819b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83a8104080 0x7f83a819b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 -- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 msgr2=0x7f83a819a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 0x7f83a819a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.748+0000 7f83a6ffd640 1 -- 172.21.15.123:0/3545480812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a819ba90 con 0x7f83a81036e0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83a6ffd640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f839c006010 tx=0x7f839c004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c03f030 con 0x7f83a81036e0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c003cb0 con 0x7f83a81036e0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a819bd20 con 0x7f83a81036e0 2024-09-21T00:39:59.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c035070 con 0x7f83a81036e0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.749+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a81a2330 con 0x7f83a81036e0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.750+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a81a2590 con 0x7f83a81036e0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.751+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f839c042030 con 0x7f83a81036e0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.752+0000 7f83a4ff9640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 0x7f83900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.752+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f839c106ce0 con 0x7f83a81036e0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.752+0000 7f83a77fe640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 0x7f83900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.753+0000 7f83a77fe640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 0x7f83900b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8398005fd0 tx=0x7f8398009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:39:59.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.756+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f839c0ce8b0 con 0x7f83a81036e0 2024-09-21T00:39:59.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:59.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:39:59.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi016 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:59.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi016 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:39:59.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:39:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:39:59.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:39:59.943+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f83a80fffd0 con 0x7f83900b6510 2024-09-21T00:40:00.259 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:39:59.905+0000 7f99ef4ca640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T00:40:00.260 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:39:59 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:39:59.912+0000 7f99e72c0640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:00.576 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:00.577 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:00.577 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:00 smithi123 ceph-mon[34853]: overall HEALTH_OK 2024-09-21T00:40:00.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:40:00.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:00.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:00 smithi016 ceph-mon[30947]: overall HEALTH_OK 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609]' entity='osd.3' 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:00.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:00 smithi178 ceph-mon[34888]: overall HEALTH_OK 2024-09-21T00:40:01.605 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:40:01.606 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:40:01.606 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:40:01.606 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] boot 2024-09-21T00:40:01.606 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T00:40:01.606 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] boot 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T00:40:01.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:01.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:40:01.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:40:01.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:40:01.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: osd.3 [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] boot 2024-09-21T00:40:01.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T00:40:01.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:40:02.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:40:02.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/2668707401' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"}]': finished 2024-09-21T00:40:02.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T00:40:02.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/2668707401' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"}]': finished 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T00:40:02.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/2668707401' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"} : dispatch 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb5b7ffd-58b4-4b23-9233-9821e51ddf23"}]': finished 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: osdmap e25: 5 total, 4 up, 5 in 2024-09-21T00:40:02.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:03 smithi016 ceph-mon[30947]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:03 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/940318073' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:03.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:03 smithi123 ceph-mon[34853]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:03.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:03 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/940318073' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:03 smithi178 ceph-mon[34888]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:03.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:03 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/940318073' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:05.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:05 smithi016 ceph-mon[30947]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:05.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:05 smithi123 ceph-mon[34853]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:05.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:05 smithi178 ceph-mon[34888]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:07.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:07 smithi016 ceph-mon[30947]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:40:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:07 smithi123 ceph-mon[34853]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:40:07.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:07 smithi178 ceph-mon[34888]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:40:09.738 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:09 smithi123 ceph-mon[34853]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:40:09.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:09 smithi016 ceph-mon[30947]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:40:09.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:09 smithi178 ceph-mon[34888]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:40:11.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:11 smithi016 ceph-mon[30947]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:40:11.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:40:11.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:11.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:11 smithi016 ceph-mon[30947]: Deploying daemon osd.4 on smithi123 2024-09-21T00:40:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:11 smithi123 ceph-mon[34853]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:40:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:40:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:11 smithi123 ceph-mon[34853]: Deploying daemon osd.4 on smithi123 2024-09-21T00:40:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:11 smithi178 ceph-mon[34888]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:40:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:40:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:11.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:11 smithi178 ceph-mon[34888]: Deploying daemon osd.4 on smithi123 2024-09-21T00:40:13.673 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:13 smithi123 ceph-mon[34853]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:40:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:13 smithi016 ceph-mon[30947]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:40:13.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:13 smithi178 ceph-mon[34888]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:40:15.703 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:15 smithi123 ceph-mon[34853]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:40:15.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:15 smithi016 ceph-mon[30947]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:40:15.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:15 smithi178 ceph-mon[34888]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:40:17.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:17 smithi016 ceph-mon[30947]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:40:17.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:17.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:17.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:17 smithi123 ceph-mon[34853]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:40:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:17 smithi178 ceph-mon[34888]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:40:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:19.697 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:19 smithi123 ceph-mon[34853]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:19.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:19 smithi016 ceph-mon[30947]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:19.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:19 smithi178 ceph-mon[34888]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:21.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:21.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:21.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:20 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:21.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:21.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:20 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:21.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:21.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:20 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.360+0000 7f83a4ff9640 1 -- 172.21.15.123:0/3545480812 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f83a80fffd0 con 0x7f83900b6510 2024-09-21T00:40:21.361 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 4 on host 'smithi123' 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 msgr2=0x7f83900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 0x7f83900b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8398005fd0 tx=0x7f8398009680 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 msgr2=0x7f83a819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f839c006010 tx=0x7f839c004340 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 shutdown_connections 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83900b6510 0x7f83900b8a20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83a8104080 0x7f83a819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83a81036e0 0x7f83a819a6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 --2- 172.21.15.123:0/3545480812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83a8102650 0x7f83a819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 >> 172.21.15.123:0/3545480812 conn(0x7f83a80fdfe0 msgr2=0x7f83a80ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:40:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 shutdown_connections 2024-09-21T00:40:21.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:40:21.362+0000 7f83adcac640 1 -- 172.21.15.123:0/3545480812 wait complete. 2024-09-21T00:40:22.016 DEBUG:teuthology.orchestra.run.smithi123:osd.4> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T00:40:22.018 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2024-09-21T00:40:22.018 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:40:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:21 smithi016 ceph-mon[30947]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:21 smithi123 ceph-mon[34853]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:22.274 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:40:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:21 smithi178 ceph-mon[34888]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:23.366 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:23 smithi178 ceph-mon[34888]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:23.399 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:23 smithi123 ceph-mon[34853]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:23.399 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:40:23 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:40:23.141+0000 7fab8d54f640 -1 osd.4 0 log_to_monitors true 2024-09-21T00:40:23.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:23 smithi016 ceph-mon[30947]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:24.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:24 smithi178 ceph-mon[34888]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:24 smithi178 ceph-mon[34888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.297 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:24 smithi123 ceph-mon[34853]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.297 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:24 smithi123 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:24 smithi016 ceph-mon[30947]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:24 smithi016 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:40:24.818 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:40:24.856 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2024-09-21T00:40:25.242 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:40:25.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:40:25.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T00:40:25.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:25.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi123 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:25.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:40:25.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi123 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:25.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi123 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:25.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 -- 172.21.15.178:0/597775453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc102670 msgr2=0x7fb0dc102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 --2- 172.21.15.178:0/597775453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc102670 0x7fb0dc102ae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009900 tx=0x7fb0cc02a480 comp rx=0 tx=0).stop 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 -- 172.21.15.178:0/597775453 shutdown_connections 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 --2- 172.21.15.178:0/597775453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 --2- 172.21.15.178:0/597775453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc103700 0x7fb0dc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 --2- 172.21.15.178:0/597775453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc102670 0x7fb0dc102ae0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 -- 172.21.15.178:0/597775453 >> 172.21.15.178:0/597775453 conn(0x7fb0dc0fdfe0 msgr2=0x7fb0dc100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 -- 172.21.15.178:0/597775453 shutdown_connections 2024-09-21T00:40:25.689 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.686+0000 7fb0e1114640 1 -- 172.21.15.178:0/597775453 wait complete. 2024-09-21T00:40:25.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 Processor -- start 2024-09-21T00:40:25.690 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 -- start start 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc102670 0x7fb0dc10cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 0x7fb0dc10b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc10f3e0 con 0x7fb0dc103700 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc10f260 con 0x7fb0dc102670 2024-09-21T00:40:25.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.687+0000 7fb0e1114640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc10f560 con 0x7fb0dc1040a0 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46920/0 (socket says 172.21.15.178:46920) 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 -- 172.21.15.178:0/399158015 learned_addr learned my addr 172.21.15.178:0/399158015 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0dad9d640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc102670 0x7fb0dc10cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0da59c640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 0x7fb0dc10b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 -- 172.21.15.178:0/399158015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc102670 msgr2=0x7fb0dc10cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc102670 0x7fb0dc10cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 -- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 msgr2=0x7fb0dc10b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 0x7fb0dc10b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 -- 172.21.15.178:0/399158015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc10c260 con 0x7fb0dc1040a0 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0da59c640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 0x7fb0dc10b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:40:25.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0db59e640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400eaa0 tx=0x7fb0d400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400cdb0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc1a40b0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0d4005020 con 0x7fb0dc1040a0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40116d0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.688+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc1a44b0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.690+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc109850 con 0x7fb0dc1040a0 2024-09-21T00:40:25.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.691+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb0d40051d0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.692+0000 7fb0c3fff640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 0x7fb0c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:25.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.692+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3821+0+0 (secure 0 0 0) 0x7fb0d40e67a0 con 0x7fb0dc1040a0 2024-09-21T00:40:25.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.692+0000 7fb0dad9d640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 0x7fb0c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:25.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.693+0000 7fb0dad9d640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 0x7fb0c40b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:40:25.697 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.695+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0d4016030 con 0x7fb0dc1040a0 2024-09-21T00:40:25.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:40:25.482+0000 7fab894d1640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T00:40:25.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:40:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:40:25.487+0000 7fab812c7640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:40:25.884 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:25.882+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb0dc063800 con 0x7fb0c40b6510 2024-09-21T00:40:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T00:40:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:40:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:40:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='osd.4 ' entity='osd.4' 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:26.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:26.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T00:40:26.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:40:26.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='osd.4 ' entity='osd.4' 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:26.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='osd.4 ' entity='osd.4' 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:26.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:26.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:26.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] boot 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T00:40:27.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:40:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:40:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] boot 2024-09-21T00:40:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T00:40:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: osd.4 [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] boot 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: osdmap e28: 5 total, 5 up, 5 in 2024-09-21T00:40:27.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/1729584946' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"}]': finished 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/2334516226' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T00:40:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/1729584946' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"}]': finished 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/2334516226' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T00:40:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/1729584946' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"} : dispatch 2024-09-21T00:40:29.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "468ee4cb-31d6-402a-8d52-add13aaef32b"}]': finished 2024-09-21T00:40:29.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: osdmap e30: 6 total, 5 up, 6 in 2024-09-21T00:40:29.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:29.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:29 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/2334516226' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:31.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:31 smithi016 ceph-mon[30947]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:31.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:31 smithi123 ceph-mon[34853]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:31.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:31 smithi178 ceph-mon[34888]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:33 smithi123 ceph-mon[34853]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:33.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:33 smithi178 ceph-mon[34888]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:33.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:33 smithi016 ceph-mon[30947]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:35 smithi178 ceph-mon[34888]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:35.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:35 smithi123 ceph-mon[34853]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:35.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:35 smithi016 ceph-mon[30947]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:37.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:37 smithi178 ceph-mon[34888]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:40:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:37.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:37 smithi123 ceph-mon[34853]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:37.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:40:37.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:37.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:37 smithi016 ceph-mon[30947]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:37.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:40:37.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:38.437 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:38 smithi178 ceph-mon[34888]: Deploying daemon osd.5 on smithi178 2024-09-21T00:40:38.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:38 smithi016 ceph-mon[30947]: Deploying daemon osd.5 on smithi178 2024-09-21T00:40:38.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:38 smithi123 ceph-mon[34853]: Deploying daemon osd.5 on smithi178 2024-09-21T00:40:39.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:39 smithi178 ceph-mon[34888]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:39.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:39 smithi016 ceph-mon[30947]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:39.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:39 smithi123 ceph-mon[34853]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:41.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:41 smithi123 ceph-mon[34853]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:41.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:41 smithi178 ceph-mon[34888]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:41.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:41 smithi016 ceph-mon[30947]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:43.536 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:43 smithi178 ceph-mon[34888]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:43.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:43 smithi016 ceph-mon[30947]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:43.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:43 smithi123 ceph-mon[34853]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:44.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:44.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:44.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:44.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:45.535 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:45 smithi178 ceph-mon[34888]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:45.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:45 smithi016 ceph-mon[30947]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:45 smithi123 ceph-mon[34853]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:47.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:47.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:47.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:47.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5 on host 'smithi178' 2024-09-21T00:40:47.423 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.422+0000 7fb0c3fff640 1 -- 172.21.15.178:0/399158015 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0dc063800 con 0x7fb0c40b6510 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 msgr2=0x7fb0c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 0x7fb0c40b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc031400 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 msgr2=0x7fb0dc10bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400eaa0 tx=0x7fb0d400ef60 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 shutdown_connections 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb0c40b6510 0x7fb0c40b8a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0dc1040a0 0x7fb0dc10bbc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0dc103700 0x7fb0dc10b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 --2- 172.21.15.178:0/399158015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0dc102670 0x7fb0dc10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:47.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 >> 172.21.15.178:0/399158015 conn(0x7fb0dc0fdfe0 msgr2=0x7fb0dc106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:40:47.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 shutdown_connections 2024-09-21T00:40:47.427 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:40:47.425+0000 7fb0e1114640 1 -- 172.21.15.178:0/399158015 wait complete. 2024-09-21T00:40:48.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:47 smithi178 ceph-mon[34888]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:48.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:48.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.045 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T00:40:48.047 INFO:tasks.cephadm:Deploying osd.6 on smithi016 with /dev/vg_nvme/lv_2... 2024-09-21T00:40:48.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:40:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:47 smithi016 ceph-mon[30947]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:47 smithi123 ceph-mon[34853]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:40:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:48.317 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:40:49.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:40:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:40:49.702+0000 7fdef37e0640 -1 osd.5 0 log_to_monitors true 2024-09-21T00:40:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:49 smithi016 ceph-mon[30947]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:49 smithi016 ceph-mon[30947]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:50.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:49 smithi016 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:49 smithi123 ceph-mon[34853]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:49 smithi123 ceph-mon[34853]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:49 smithi123 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:49 smithi178 ceph-mon[34888]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:49 smithi178 ceph-mon[34888]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:49 smithi178 ceph-mon[34888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:51.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi178 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:51.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:40:51.131 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2024-09-21T00:40:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:40:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:40:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:51.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi178 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-21T00:40:51.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.273 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:51.273 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:51.273 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.287 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:40:51.008+0000 7fdeef762640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T00:40:51.287 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:40:51.013+0000 7fdeeb560640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi178 2024-09-21T00:40:51.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:40:51.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:40:51.393 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:40:51.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 -- 172.21.15.16:0/775898134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 msgr2=0x7f318c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:51.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 --2- 172.21.15.16:0/775898134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c103ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3180009900 tx=0x7f318002a480 comp rx=0 tx=0).stop 2024-09-21T00:40:51.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 -- 172.21.15.16:0/775898134 shutdown_connections 2024-09-21T00:40:51.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 --2- 172.21.15.16:0/775898134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 0x7f318c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 --2- 172.21.15.16:0/775898134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c103ae0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 --2- 172.21.15.16:0/775898134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 0x7f318c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 -- 172.21.15.16:0/775898134 >> 172.21.15.16:0/775898134 conn(0x7f318c0fdfb0 msgr2=0x7f318c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 -- 172.21.15.16:0/775898134 shutdown_connections 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.935+0000 7f3192efe640 1 -- 172.21.15.16:0/775898134 wait complete. 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 Processor -- start 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 -- start start 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 0x7f318c10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 0x7f318c10bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:51.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f318c10f470 con 0x7f318c1036d0 2024-09-21T00:40:51.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f318c10f2f0 con 0x7f318c104070 2024-09-21T00:40:51.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3192efe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f318c10f5f0 con 0x7f318c102640 2024-09-21T00:40:51.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f318bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:51.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f318bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57712/0 (socket says 172.21.15.16:57712) 2024-09-21T00:40:51.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f318bfff640 1 -- 172.21.15.16:0/1618275947 learned_addr learned my addr 172.21.15.16:0/1618275947 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:40:51.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f319149b640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 0x7f318c10bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:51.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.936+0000 7f3190c9a640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 0x7f318c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 -- 172.21.15.16:0/1618275947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 msgr2=0x7f318c10cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 0x7f318c10cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 -- 172.21.15.16:0/1618275947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 msgr2=0x7f318c10bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 0x7f318c10bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 -- 172.21.15.16:0/1618275947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c10c290 con 0x7f318c1036d0 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f318bfff640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3180006010 tx=0x7f31800043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:40:51.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318003f030 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3180003cb0 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c1a41b0 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180035070 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.937+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c1a4620 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.938+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c102b30 con 0x7f318c1036d0 2024-09-21T00:40:51.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.940+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3180042030 con 0x7f318c1036d0 2024-09-21T00:40:51.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.940+0000 7f3189ffb640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 0x7f31740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:40:51.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.941+0000 7f3190c9a640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 0x7f31740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:40:51.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.941+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4253+0+0 (secure 0 0 0) 0x7f3180106b00 con 0x7f318c1036d0 2024-09-21T00:40:51.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.941+0000 7f3190c9a640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 0x7f31740b8aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f317c009890 tx=0x7f317c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:40:51.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:51.945+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31800ce370 con 0x7f318c1036d0 2024-09-21T00:40:52.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:40:52.147+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f318c063800 con 0x7f31740b6590 2024-09-21T00:40:52.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:52 smithi016 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:40:52.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:52 smithi016 ceph-mon[30947]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:40:52.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:52 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:52.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:52 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:52 smithi123 ceph-mon[34853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:40:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:52 smithi123 ceph-mon[34853]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:40:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:52 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:52 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:52 smithi178 ceph-mon[34888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:40:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:52 smithi178 ceph-mon[34888]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T00:40:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:52 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:52 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] boot 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:53.018 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:53.019 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:53.019 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:53 smithi016 ceph-mon[30947]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:40:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:40:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] boot 2024-09-21T00:40:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:53.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:53 smithi123 ceph-mon[34853]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: osd.5 [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] boot 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: osdmap e33: 6 total, 6 up, 6 in 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:40:53.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:40:53.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:40:53.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:53 smithi178 ceph-mon[34888]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:40:54.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:54 smithi016 ceph-mon[30947]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:40:54.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:54 smithi123 ceph-mon[34853]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:40:54.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:54 smithi178 ceph-mon[34888]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T00:40:55.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:40:55.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:40:55.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"} : dispatch 2024-09-21T00:40:55.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"}]': finished 2024-09-21T00:40:55.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T00:40:55.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"} : dispatch 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"}]': finished 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T00:40:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"} : dispatch 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2927270771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6ffe0c-1477-4a08-9609-e7c559dfe280"}]': finished 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: osdmap e36: 7 total, 6 up, 7 in 2024-09-21T00:40:55.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:40:56.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:56 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2852938760' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:56.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:56 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2852938760' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:56.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:56 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2852938760' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:40:57.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:57 smithi016 ceph-mon[30947]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T00:40:57.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:57 smithi123 ceph-mon[34853]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T00:40:57.536 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:57 smithi178 ceph-mon[34888]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-21T00:40:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:40:59 smithi123 ceph-mon[34853]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:40:59.536 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:40:59 smithi178 ceph-mon[34888]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:40:59.649 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:40:59 smithi016 ceph-mon[30947]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:41:01.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:01 smithi016 ceph-mon[30947]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:41:01.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:01 smithi123 ceph-mon[34853]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:41:01.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:01 smithi178 ceph-mon[34888]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:41:03.522 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:03 smithi016 ceph-mon[30947]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:41:03.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:03 smithi178 ceph-mon[34888]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:41:03.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:03 smithi123 ceph-mon[34853]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:41:04.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:41:04.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:04.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:04 smithi178 ceph-mon[34888]: Deploying daemon osd.6 on smithi016 2024-09-21T00:41:04.663 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:41:04.663 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:04.663 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:04 smithi016 ceph-mon[30947]: Deploying daemon osd.6 on smithi016 2024-09-21T00:41:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:41:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:04.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:04 smithi123 ceph-mon[34853]: Deploying daemon osd.6 on smithi016 2024-09-21T00:41:05.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:05 smithi178 ceph-mon[34888]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:05.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:05 smithi016 ceph-mon[30947]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:05.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:05 smithi123 ceph-mon[34853]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:07.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:07 smithi178 ceph-mon[34888]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:41:07.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:07 smithi016 ceph-mon[30947]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:41:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:07 smithi123 ceph-mon[34853]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:41:09.447 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:09 smithi016 ceph-mon[30947]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:09.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:09 smithi178 ceph-mon[34888]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:09.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:09 smithi123 ceph-mon[34853]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:10.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:10 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:10.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:10 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:10.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:10 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:10.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:10 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:10.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:10 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:10.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:10 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:10 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:10 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:10.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:10 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:11.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:11 smithi016 ceph-mon[30947]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:11.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:11 smithi178 ceph-mon[34888]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:11 smithi123 ceph-mon[34853]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.084+0000 7f3189ffb640 1 -- 172.21.15.16:0/1618275947 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f318c063800 con 0x7f31740b6590 2024-09-21T00:41:14.085 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 6 on host 'smithi016' 2024-09-21T00:41:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 msgr2=0x7f31740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 0x7f31740b8aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f317c009890 tx=0x7f317c008040 comp rx=0 tx=0).stop 2024-09-21T00:41:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 msgr2=0x7f318c10b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3180006010 tx=0x7f31800043b0 comp rx=0 tx=0).stop 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 shutdown_connections 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f31740b6590 0x7f31740b8aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c104070 0x7f318c10bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f318c1036d0 0x7f318c10b650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 --2- 172.21.15.16:0/1618275947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f318c102640 0x7f318c10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 >> 172.21.15.16:0/1618275947 conn(0x7f318c0fdfb0 msgr2=0x7f318c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 shutdown_connections 2024-09-21T00:41:14.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:41:14.086+0000 7f3192efe640 1 -- 172.21.15.16:0/1618275947 wait complete. 2024-09-21T00:41:14.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:14.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:14.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:14.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:14.802 DEBUG:teuthology.orchestra.run.smithi016:osd.6> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T00:41:14.805 INFO:tasks.cephadm:Deploying osd.7 on smithi123 with /dev/vg_nvme/lv_2... 2024-09-21T00:41:14.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:41:15.043 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:14 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:15.043 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:14 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:15.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:14 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:15.062 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:41:15.182 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:14 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:15.183 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:14 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:15.183 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:14 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:15.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:14 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:15.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:14 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:15.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:14 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:16.197 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:15 smithi016 ceph-mon[30947]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:16.198 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:41:16 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:41:16.097+0000 7fb97f68a640 -1 osd.6 0 log_to_monitors true 2024-09-21T00:41:16.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:15 smithi123 ceph-mon[34853]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:16.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:15 smithi178 ceph-mon[34888]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:17.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:16 smithi123 ceph-mon[34853]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:41:17.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:16 smithi016 ceph-mon[30947]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:41:17.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:16 smithi178 ceph-mon[34888]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:41:17.901 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:41:17.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-09-21T00:41:18.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:18.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:41:18.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:18.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:17 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.176 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:41:18.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:18.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:41:18.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:41:18.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:18.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:17 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:18.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:18.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:18.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:17 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:18.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 -- 172.21.15.123:0/125277691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05006c620 msgr2=0x7fa050106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 --2- 172.21.15.123:0/125277691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05006c620 0x7fa050106420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa040009900 tx=0x7fa04002a410 comp rx=0 tx=0).stop 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 -- 172.21.15.123:0/125277691 shutdown_connections 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 --2- 172.21.15.123:0/125277691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0501094a0 0x7fa05010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 --2- 172.21.15.123:0/125277691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa050106960 0x7fa050108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 --2- 172.21.15.123:0/125277691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05006c620 0x7fa050106420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 -- 172.21.15.123:0/125277691 >> 172.21.15.123:0/125277691 conn(0x7fa0500fdfe0 msgr2=0x7fa050100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 -- 172.21.15.123:0/125277691 shutdown_connections 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.660+0000 7fa055ce6640 1 -- 172.21.15.123:0/125277691 wait complete. 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 Processor -- start 2024-09-21T00:41:18.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 -- start start 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa05006c620 0x7fa05019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0501094a0 0x7fa05019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010f3a0 con 0x7fa0501094a0 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010f220 con 0x7fa050106960 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa055ce6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010f520 con 0x7fa05006c620 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa046ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa046ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50438/0 (socket says 172.21.15.123:50438) 2024-09-21T00:41:18.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa046ffd640 1 -- 172.21.15.123:0/2682283592 learned_addr learned my addr 172.21.15.123:0/2682283592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa04ffff640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0501094a0 0x7fa05019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.661+0000 7fa04f7fe640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa05006c620 0x7fa05019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 -- 172.21.15.123:0/2682283592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa05006c620 msgr2=0x7fa05019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa05006c620 0x7fa05019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 -- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0501094a0 msgr2=0x7fa05019b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0501094a0 0x7fa05019b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 -- 172.21.15.123:0/2682283592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05019ba30 con 0x7fa050106960 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa046ffd640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c890 tx=0x7fa03800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038004220 con 0x7fa050106960 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0380043c0 con 0x7fa050106960 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05019bd20 con 0x7fa050106960 2024-09-21T00:41:18.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038004a00 con 0x7fa050106960 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.662+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0501a2420 con 0x7fa050106960 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.663+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0500ffb00 con 0x7fa050106960 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.664+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa0380079b0 con 0x7fa050106960 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.665+0000 7fa04d7fa640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 0x7fa03c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.666+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4685+0+0 (secure 0 0 0) 0x7fa0380e6100 con 0x7fa050106960 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.666+0000 7fa04f7fe640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 0x7fa03c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.666+0000 7fa04f7fe640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 0x7fa03c0b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa040000c00 tx=0x7fa040031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:41:18.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.670+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa038014030 con 0x7fa050106960 2024-09-21T00:41:18.760 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:41:18.401+0000 7fb97b60c640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T00:41:18.760 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:41:18.410+0000 7fb973402640 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:41:18.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:18.857+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa050063800 con 0x7fa03c0b6590 2024-09-21T00:41:19.236 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi016 2024-09-21T00:41:19.236 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-21T00:41:19.236 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:41:19.236 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:41:19.236 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.237 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.237 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' 2024-09-21T00:41:19.237 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:19.237 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:19.237 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi016 2024-09-21T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' 2024-09-21T00:41:19.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:19.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:19.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi016 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826]' entity='osd.6' 2024-09-21T00:41:19.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:19.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:19.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:41:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:41:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] boot 2024-09-21T00:41:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T00:41:20.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:19 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:20.269 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] boot 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T00:41:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:19 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: osd.6 [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] boot 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: osdmap e39: 7 total, 7 up, 7 in 2024-09-21T00:41:20.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:19 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:41:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/711723938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"}]': finished 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:22.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/4002734878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/711723938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"}]': finished 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/4002734878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/711723938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"} : dispatch 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4555d360-ad10-49c0-9972-1b7b0ddde002"}]': finished 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: osdmap e41: 8 total, 7 up, 8 in 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:22.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/4002734878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:24.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:23 smithi016 ceph-mon[30947]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:24.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:23 smithi123 ceph-mon[34853]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:24.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:23 smithi178 ceph-mon[34888]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:26.238 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:25 smithi123 ceph-mon[34853]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:26.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:25 smithi016 ceph-mon[30947]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:26.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:25 smithi178 ceph-mon[34888]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:27 smithi016 ceph-mon[30947]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:27 smithi123 ceph-mon[34853]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:28.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:27 smithi178 ceph-mon[34888]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:30.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:29 smithi016 ceph-mon[30947]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:29 smithi123 ceph-mon[34853]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:29 smithi178 ceph-mon[34888]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:31.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:41:31.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:41:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:41:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:32.053 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:31 smithi123 ceph-mon[34853]: Deploying daemon osd.7 on smithi123 2024-09-21T00:41:32.053 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:31 smithi123 ceph-mon[34853]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:31 smithi016 ceph-mon[30947]: Deploying daemon osd.7 on smithi123 2024-09-21T00:41:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:31 smithi016 ceph-mon[30947]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:31 smithi178 ceph-mon[34888]: Deploying daemon osd.7 on smithi123 2024-09-21T00:41:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:31 smithi178 ceph-mon[34888]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:34.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:33 smithi016 ceph-mon[30947]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:34 smithi123 ceph-mon[34853]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:34 smithi178 ceph-mon[34888]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:36.139 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:36 smithi123 ceph-mon[34853]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:36.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:36 smithi016 ceph-mon[30947]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:36 smithi178 ceph-mon[34888]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:37.097 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:37.097 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:37.097 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:37 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:37.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:37.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:37.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:37 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:37 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:38.257 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:38 smithi123 ceph-mon[34853]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:38 smithi016 ceph-mon[30947]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:38 smithi178 ceph-mon[34888]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:39.070 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:39 smithi123 ceph-mon[34853]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:39.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:39 smithi178 ceph-mon[34888]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:39.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:39 smithi016 ceph-mon[30947]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:40 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:40 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:40 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:40 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:40 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.449 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 7 on host 'smithi123' 2024-09-21T00:41:40.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.448+0000 7fa04d7fa640 1 -- 172.21.15.123:0/2682283592 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa050063800 con 0x7fa03c0b6590 2024-09-21T00:41:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 msgr2=0x7fa03c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 0x7fa03c0b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa040000c00 tx=0x7fa040031400 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 msgr2=0x7fa05019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c890 tx=0x7fa03800cd50 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 shutdown_connections 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa03c0b6590 0x7fa03c0b8aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0501094a0 0x7fa05019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa050106960 0x7fa05019a670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 --2- 172.21.15.123:0/2682283592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa05006c620 0x7fa05019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 >> 172.21.15.123:0/2682283592 conn(0x7fa0500fdfe0 msgr2=0x7fa050104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 shutdown_connections 2024-09-21T00:41:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:41:40.451+0000 7fa055ce6640 1 -- 172.21.15.123:0/2682283592 wait complete. 2024-09-21T00:41:40.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:40 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:40 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:40 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:40.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:40 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:40.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:40 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:40 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:40 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:40.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:40 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:40.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:40 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:40.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:40 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.208 DEBUG:teuthology.orchestra.run.smithi123:osd.7> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T00:41:41.211 INFO:tasks.cephadm:Deploying osd.8 on smithi178 with /dev/vg_nvme/lv_2... 2024-09-21T00:41:41.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:41:41.438 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:41 smithi123 ceph-mon[34853]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:41.438 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:41.438 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.438 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:41 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.467 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:41:41.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:41 smithi178 ceph-mon[34888]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:41.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:41.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:41 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:41 smithi016 ceph-mon[30947]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:41.766 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:41:41.766 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:41.766 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:41 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:42.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:42 smithi123 ceph-mon[34853]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:42.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:42 smithi123 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:42.521 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:41:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:41:42.233+0000 7fd86f369640 -1 osd.7 0 log_to_monitors true 2024-09-21T00:41:42.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:42 smithi178 ceph-mon[34888]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:42.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:42 smithi178 ceph-mon[34888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:42.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:42 smithi016 ceph-mon[30947]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:42.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:42 smithi016 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:43 smithi178 ceph-mon[34888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.742 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:41:43.282+0000 7fd86b2eb640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T00:41:43.742 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:41:43.295+0000 7fd8670e9640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.743 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:43 smithi123 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: from='osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:43 smithi016 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:41:43.996 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:41:44.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2024-09-21T00:41:44.281 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:41:44.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:44.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] boot 2024-09-21T00:41:44.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T00:41:44.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:44 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] boot 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T00:41:44.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:44 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:41:44.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: osd.7 [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] boot 2024-09-21T00:41:44.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: osdmap e44: 8 total, 8 up, 8 in 2024-09-21T00:41:44.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:44 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 -- 172.21.15.178:0/709299650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8105180 msgr2=0x7fb8c810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 --2- 172.21.15.178:0/709299650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8105180 0x7fb8c810bb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009900 tx=0x7fb8c002a480 comp rx=0 tx=0).stop 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 -- 172.21.15.178:0/709299650 shutdown_connections 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 --2- 172.21.15.178:0/709299650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8105180 0x7fb8c810bb20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 --2- 172.21.15.178:0/709299650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c81047e0 0x7fb8c8104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 --2- 172.21.15.178:0/709299650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8103750 0x7fb8c8103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 -- 172.21.15.178:0/709299650 >> 172.21.15.178:0/709299650 conn(0x7fb8c80ff0c0 msgr2=0x7fb8c8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 -- 172.21.15.178:0/709299650 shutdown_connections 2024-09-21T00:41:44.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.779+0000 7fb8d0034640 1 -- 172.21.15.178:0/709299650 wait complete. 2024-09-21T00:41:44.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 Processor -- start 2024-09-21T00:41:44.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 -- start start 2024-09-21T00:41:44.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c8103750 0x7fb8c8199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8105180 0x7fb8c819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c810f3a0 con 0x7fb8c8105180 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c810f220 con 0x7fb8c8103750 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8d0034640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c810f520 con 0x7fb8c81047e0 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8cd5cf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8cd5cf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:36928/0 (socket says 172.21.15.178:36928) 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8cd5cf640 1 -- 172.21.15.178:0/32257529 learned_addr learned my addr 172.21.15.178:0/32257529 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8ce5d1640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8105180 0x7fb8c819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.780+0000 7fb8cddd0640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c8103750 0x7fb8c8199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:44.783 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 -- 172.21.15.178:0/32257529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c8103750 msgr2=0x7fb8c8199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c8103750 0x7fb8c8199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 -- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8105180 msgr2=0x7fb8c819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8105180 0x7fb8c819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 -- 172.21.15.178:0/32257529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c819b970 con 0x7fb8c81047e0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8cd5cf640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d770 tx=0x7fb8bc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc017070 con 0x7fb8c81047e0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c819bc60 con 0x7fb8c81047e0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8bc0054d0 con 0x7fb8c81047e0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc004c30 con 0x7fb8c81047e0 2024-09-21T00:41:44.784 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.781+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c81a2360 con 0x7fb8c81047e0 2024-09-21T00:41:44.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.782+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c810a910 con 0x7fb8c81047e0 2024-09-21T00:41:44.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.783+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb8bc004dd0 con 0x7fb8c81047e0 2024-09-21T00:41:44.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.784+0000 7fb8c6ffd640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:41:44.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.784+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5430+0+0 (secure 0 0 0) 0x7fb8bc0e6600 con 0x7fb8c81047e0 2024-09-21T00:41:44.785 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.784+0000 7fb8cddd0640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:41:44.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.785+0000 7fb8cddd0640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 0x7fb8b00b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8005fd0 tx=0x7fb8b8009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:41:44.788 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.787+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8bc0b1db0 con 0x7fb8c81047e0 2024-09-21T00:41:44.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:41:44.978+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb8c8063800 con 0x7fb8b00b6510 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi123 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:45.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:45.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi123 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:45.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:45.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:45.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi123 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:41:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:45.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:41:45.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:41:45.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:46.606 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:46 smithi178 ceph-mon[34888]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:41:46.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:46 smithi016 ceph-mon[30947]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:41:46.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:46 smithi123 ceph-mon[34853]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T00:41:47.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:47 smithi178 ceph-mon[34888]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:47.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:47 smithi178 ceph-mon[34888]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:41:47.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:47 smithi016 ceph-mon[30947]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:47.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:47 smithi016 ceph-mon[30947]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:41:47.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:47 smithi123 ceph-mon[34853]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:47.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:47 smithi123 ceph-mon[34853]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/1666873714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"}]': finished 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:41:48.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:48 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/402186915' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:48.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/1666873714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"}]': finished 2024-09-21T00:41:48.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:41:48.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:41:48.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:48 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/402186915' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/1666873714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"} : dispatch 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70b08292-671a-4458-91a5-c07975068f65"}]': finished 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:41:48.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:48 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/402186915' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:41:50.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:49 smithi016 ceph-mon[30947]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:50.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:49 smithi123 ceph-mon[34853]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:50.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:49 smithi178 ceph-mon[34888]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:41:51.996 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:51 smithi178 ceph-mon[34888]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:41:52.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:51 smithi016 ceph-mon[30947]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:41:52.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:51 smithi123 ceph-mon[34853]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:41:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:53 smithi178 ceph-mon[34888]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:41:54.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:53 smithi016 ceph-mon[30947]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:41:54.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:53 smithi123 ceph-mon[34853]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:41:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:55 smithi178 ceph-mon[34888]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:41:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:41:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:56.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:55 smithi016 ceph-mon[30947]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:41:56.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:41:56.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:56.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:55 smithi123 ceph-mon[34853]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:41:56.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:41:56.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:41:56.849 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:56 smithi178 ceph-mon[34888]: Deploying daemon osd.8 on smithi178 2024-09-21T00:41:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:56 smithi016 ceph-mon[30947]: Deploying daemon osd.8 on smithi178 2024-09-21T00:41:57.062 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:56 smithi123 ceph-mon[34853]: Deploying daemon osd.8 on smithi178 2024-09-21T00:41:57.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:57 smithi178 ceph-mon[34888]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:58.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:57 smithi016 ceph-mon[30947]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:58.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:57 smithi123 ceph-mon[34853]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:41:59.822 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:41:59 smithi123 ceph-mon[34853]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:42:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:41:59 smithi016 ceph-mon[30947]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:42:00.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:41:59 smithi178 ceph-mon[34888]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T00:42:02.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:01 smithi016 ceph-mon[30947]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:02.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:01 smithi123 ceph-mon[34853]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:02.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:01 smithi178 ceph-mon[34888]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:02.704 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:02.704 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:02.704 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:04.002 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:03 smithi178 ceph-mon[34888]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:04.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:03 smithi016 ceph-mon[30947]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:04.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:03 smithi123 ceph-mon[34853]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:04.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.990+0000 7fb8c6ffd640 1 -- 172.21.15.178:0/32257529 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb8c8063800 con 0x7fb8b00b6510 2024-09-21T00:42:04.992 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 8 on host 'smithi178' 2024-09-21T00:42:04.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 msgr2=0x7fb8b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:04.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 0x7fb8b00b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8005fd0 tx=0x7fb8b8009680 comp rx=0 tx=0).stop 2024-09-21T00:42:04.994 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 msgr2=0x7fb8c819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00d770 tx=0x7fb8bc00dc30 comp rx=0 tx=0).stop 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 shutdown_connections 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c8105180 0x7fb8c819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c81047e0 0x7fb8c819a5b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 --2- 172.21.15.178:0/32257529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8c8103750 0x7fb8c8199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 >> 172.21.15.178:0/32257529 conn(0x7fb8c80ff0c0 msgr2=0x7fb8c8107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 shutdown_connections 2024-09-21T00:42:04.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:42:04.993+0000 7fb8d0034640 1 -- 172.21.15.178:0/32257529 wait complete. 2024-09-21T00:42:05.606 DEBUG:teuthology.orchestra.run.smithi178:osd.8> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T00:42:05.609 INFO:tasks.cephadm:Deploying osd.9 on smithi016 with /dev/vg_nvme/lv_1... 2024-09-21T00:42:05.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:42:05.887 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:42:06.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:05 smithi178 ceph-mon[34888]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:06.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.237 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.237 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.237 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:05 smithi016 ceph-mon[30947]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:06.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:05 smithi123 ceph-mon[34853]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:08.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:07 smithi178 ceph-mon[34888]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:08.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:07 smithi178 ceph-mon[34888]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:07 smithi178 ceph-mon[34888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.038 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:42:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:42:07.735+0000 7f373d81e640 -1 osd.8 0 log_to_monitors true 2024-09-21T00:42:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:07 smithi016 ceph-mon[30947]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:08.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:07 smithi016 ceph-mon[30947]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:07 smithi016 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:07 smithi123 ceph-mon[34853]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:08.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:07 smithi123 ceph-mon[34853]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:07 smithi123 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:42:08.829 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:42:08.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi016:vg_nvme/lv_1 2024-09-21T00:42:09.144 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:42:09.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:42:09.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:42:09.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:09.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:42:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:42:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:09.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.287 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:42:09.000+0000 7f37397a0640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T00:42:09.287 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:42:09.009+0000 7f373559e640 -1 osd.8 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:09.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 -- 172.21.15.16:0/3757249353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62881026f0 msgr2=0x7f6288102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 --2- 172.21.15.16:0/3757249353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62881026f0 0x7f6288102b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6284009900 tx=0x7f628402a480 comp rx=0 tx=0).stop 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 -- 172.21.15.16:0/3757249353 shutdown_connections 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 --2- 172.21.15.16:0/3757249353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 0x7f628810aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 --2- 172.21.15.16:0/3757249353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6288103780 0x7f6288103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 --2- 172.21.15.16:0/3757249353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62881026f0 0x7f6288102b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 -- 172.21.15.16:0/3757249353 >> 172.21.15.16:0/3757249353 conn(0x7f62880fe080 msgr2=0x7f6288100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 -- 172.21.15.16:0/3757249353 shutdown_connections 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.634+0000 7f628fdbe640 1 -- 172.21.15.16:0/3757249353 wait complete. 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 Processor -- start 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 -- start start 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62881026f0 0x7f628806c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 0x7f62881a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f628810e2c0 con 0x7f6288103780 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f628810e140 con 0x7f62881026f0 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.635+0000 7f628fdbe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f628810e440 con 0x7f6288104120 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36898/0 (socket says 172.21.15.16:36898) 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 -- 172.21.15.16:0/2308462552 learned_addr learned my addr 172.21.15.16:0/2308462552 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628e35b640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 0x7f62881a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628db5a640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62881026f0 0x7f628806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 -- 172.21.15.16:0/2308462552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 msgr2=0x7f62881a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 0x7f62881a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 -- 172.21.15.16:0/2308462552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62881026f0 msgr2=0x7f628806c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62881026f0 0x7f628806c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 -- 172.21.15.16:0/2308462552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881a1a80 con 0x7f6288103780 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628d359640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f627800e9f0 tx=0x7f627800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800cd80 con 0x7f6288103780 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62780108e0 con 0x7f6288103780 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62881a1d70 con 0x7f6288103780 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.636+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278018980 con 0x7f6288103780 2024-09-21T00:42:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.637+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a21f0 con 0x7f6288103780 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.638+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62881098d0 con 0x7f6288103780 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.640+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6278010430 con 0x7f6288103780 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.641+0000 7f627effd640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 0x7f62740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.641+0000 7f628db5a640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 0x7f62740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.641+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5549+0+0 (secure 0 0 0) 0x7f62780e6bc0 con 0x7f6288103780 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.641+0000 7f628db5a640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 0x7f62740b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6284000c00 tx=0x7f6284031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:42:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.646+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62780b2260 con 0x7f6288103780 2024-09-21T00:42:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:09.848+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6288063800 con 0x7f62740b6510 2024-09-21T00:42:10.197 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:10.197 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi178 2024-09-21T00:42:10.197 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:10.198 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi178 2024-09-21T00:42:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-21T00:42:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:10.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi178 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:10.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:11.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:42:11.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:42:11.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:11.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] boot 2024-09-21T00:42:11.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T00:42:11.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] boot 2024-09-21T00:42:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T00:42:11.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:11.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: osd.8 [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] boot 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: osdmap e50: 9 total, 9 up, 9 in 2024-09-21T00:42:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:42:12.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:12 smithi016 ceph-mon[30947]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:12.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:12 smithi016 ceph-mon[30947]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:42:12.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:12 smithi123 ceph-mon[34853]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:12.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:12 smithi123 ceph-mon[34853]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:42:12.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:12 smithi178 ceph-mon[34888]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:42:12.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:12 smithi178 ceph-mon[34888]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"} : dispatch 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"}]': finished 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T00:42:13.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:13.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:42:13.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:13.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"} : dispatch 2024-09-21T00:42:13.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"}]': finished 2024-09-21T00:42:13.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T00:42:13.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"} : dispatch 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4087380475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32770935-de25-4c09-b1dc-98c5aa14468f"}]': finished 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T00:42:13.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:14.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:14 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1192484308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:14.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:14 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1192484308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:14.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:14 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1192484308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:15.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:15 smithi178 ceph-mon[34888]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:15.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:15 smithi016 ceph-mon[30947]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:15.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:15 smithi123 ceph-mon[34853]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:17.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:17 smithi016 ceph-mon[30947]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:42:17.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:17 smithi178 ceph-mon[34888]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:42:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:17 smithi123 ceph-mon[34853]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:42:19.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:19 smithi178 ceph-mon[34888]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:42:19.623 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:19 smithi016 ceph-mon[30947]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:42:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:19 smithi123 ceph-mon[34853]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T00:42:21.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:21 smithi178 ceph-mon[34888]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:42:21.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:42:21.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:21.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:21 smithi178 ceph-mon[34888]: Deploying daemon osd.9 on smithi016 2024-09-21T00:42:21.627 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:21 smithi016 ceph-mon[30947]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:42:21.627 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:42:21.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:21.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:21 smithi016 ceph-mon[30947]: Deploying daemon osd.9 on smithi016 2024-09-21T00:42:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:21 smithi123 ceph-mon[34853]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T00:42:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:42:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:21 smithi123 ceph-mon[34853]: Deploying daemon osd.9 on smithi016 2024-09-21T00:42:23.656 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:23 smithi016 ceph-mon[30947]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:42:23.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:23 smithi123 ceph-mon[34853]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:42:23.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:23 smithi178 ceph-mon[34888]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:42:25.738 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:25 smithi016 ceph-mon[30947]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:42:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:25 smithi123 ceph-mon[34853]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:42:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:25 smithi178 ceph-mon[34888]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:42:27.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:27 smithi016 ceph-mon[30947]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:27.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:27.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:27.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:27 smithi123 ceph-mon[34853]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:27.838 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:27.838 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:27.838 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:27.839 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:27 smithi178 ceph-mon[34888]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:42:27.839 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:27.839 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:27.839 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:29.571 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:29 smithi123 ceph-mon[34853]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:29.654 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:29 smithi016 ceph-mon[30947]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:29.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:29 smithi178 ceph-mon[34888]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:30.711 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 9 on host 'smithi016' 2024-09-21T00:42:30.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.709+0000 7f627effd640 1 -- 172.21.15.16:0/2308462552 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6288063800 con 0x7f62740b6510 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 msgr2=0x7f62740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 0x7f62740b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6284000c00 tx=0x7f6284031400 comp rx=0 tx=0).stop 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 msgr2=0x7f628819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f627800e9f0 tx=0x7f627800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 shutdown_connections 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62740b6510 0x7f62740b8a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6288104120 0x7f62881a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6288103780 0x7f628819ed30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:30.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 --2- 172.21.15.16:0/2308462552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62881026f0 0x7f628806c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 >> 172.21.15.16:0/2308462552 conn(0x7f62880fe080 msgr2=0x7f6288106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:42:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 shutdown_connections 2024-09-21T00:42:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:42:30.713+0000 7f628fdbe640 1 -- 172.21.15.16:0/2308462552 wait complete. 2024-09-21T00:42:31.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:30 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:31.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:30 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:30 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:31.427 DEBUG:teuthology.orchestra.run.smithi016:osd.9> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T00:42:31.429 INFO:tasks.cephadm:Deploying osd.10 on smithi123 with /dev/vg_nvme/lv_1... 2024-09-21T00:42:31.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:42:31.685 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:42:32.060 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:31 smithi123 ceph-mon[34853]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:31 smithi016 ceph-mon[30947]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:31 smithi178 ceph-mon[34888]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:32.731 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:42:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:42:32.661+0000 7f6cb79ec640 -1 osd.9 0 log_to_monitors true 2024-09-21T00:42:33.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:32 smithi016 ceph-mon[30947]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:42:33.117 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:32 smithi123 ceph-mon[34853]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:42:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:32 smithi178 ceph-mon[34888]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:42:34.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:33 smithi123 ceph-mon[34853]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:34.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:33 smithi123 ceph-mon[34853]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:42:34.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:33 smithi123 ceph-mon[34853]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:42:34.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:33 smithi123 ceph-mon[34853]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:42:34.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:34.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-mon[30947]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:34.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-mon[30947]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:42:34.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-mon[30947]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:42:34.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-mon[30947]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:42:34.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:34.140 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:42:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:42:33.989+0000 7f6cb396e640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T00:42:34.140 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:42:34.000+0000 7f6caf76c640 -1 osd.9 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:42:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:33 smithi178 ceph-mon[34888]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:33 smithi178 ceph-mon[34888]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:42:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:33 smithi178 ceph-mon[34888]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:42:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:33 smithi178 ceph-mon[34888]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-21T00:42:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:34.426 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T00:42:34.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_1 2024-09-21T00:42:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:42:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 -- 172.21.15.123:0/3379105803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4101b20 msgr2=0x7f44b4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 --2- 172.21.15.123:0/3379105803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4101b20 0x7f44b4101f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009900 tx=0x7f44a402a410 comp rx=0 tx=0).stop 2024-09-21T00:42:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 -- 172.21.15.123:0/3379105803 shutdown_connections 2024-09-21T00:42:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 --2- 172.21.15.123:0/3379105803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4109470 0x7f44b410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 --2- 172.21.15.123:0/3379105803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 0x7f44b4108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 --2- 172.21.15.123:0/3379105803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4101b20 0x7f44b4101f30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 -- 172.21.15.123:0/3379105803 >> 172.21.15.123:0/3379105803 conn(0x7f44b40fd770 msgr2=0x7f44b40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.232+0000 7f44b9a10640 1 -- 172.21.15.123:0/3379105803 shutdown_connections 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.233+0000 7f44b9a10640 1 -- 172.21.15.123:0/3379105803 wait complete. 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.233+0000 7f44b9a10640 1 Processor -- start 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.233+0000 7f44b9a10640 1 -- start start 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.233+0000 7f44b9a10640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 0x7f44b41042b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.233+0000 7f44b9a10640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 0x7f44b4102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410f370 con 0x7f44b4101b20 2024-09-21T00:42:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410f1f0 con 0x7f44b4109470 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410f4f0 con 0x7f44b4102550 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46646/0 (socket says 172.21.15.123:46646) 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 -- 172.21.15.123:0/2565239802 learned_addr learned my addr 172.21.15.123:0/2565239802 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b27fc640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 0x7f44b4102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b2ffd640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 0x7f44b41042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 -- 172.21.15.123:0/2565239802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 msgr2=0x7f44b4102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 0x7f44b4102b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 -- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 msgr2=0x7f44b41042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 0x7f44b41042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 -- 172.21.15.123:0/2565239802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b41037c0 con 0x7f44b4109470 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b2ffd640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 0x7f44b41042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:42:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b37fe640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00eaa0 tx=0x7f44ac00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00cdb0 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44ac005020 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b41a4030 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0116d0 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.234+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b41a4490 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.235+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b40ff290 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.237+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f44ac0051d0 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.238+0000 7f44b8a0e640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 0x7f449c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.238+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6261+0+0 (secure 0 0 0) 0x7f44ac0e70a0 con 0x7f44b4109470 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.238+0000 7f44b2ffd640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 0x7f449c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.239+0000 7f44b2ffd640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 0x7f449c0b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005f70 tx=0x7f44a4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:42:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.241+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44ac016030 con 0x7f44b4109470 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:35.259 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:34 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:35.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:35.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:34 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:42:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:42:35.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:34 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:35.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:35.439+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f44b4063800 con 0x7f449c0b6510 2024-09-21T00:42:36.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:42:36.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi016 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] boot 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:36.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi016 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] boot 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T00:42:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:36.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi016 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: osd.9 [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] boot 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: osdmap e56: 10 total, 10 up, 10 in 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:42:36.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:37.206 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:37 smithi123 ceph-mon[34853]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:37.206 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:37 smithi123 ceph-mon[34853]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:42:37.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:37 smithi016 ceph-mon[30947]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:37.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:37 smithi016 ceph-mon[30947]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:42:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:37 smithi178 ceph-mon[34888]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:37 smithi178 ceph-mon[34888]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T00:42:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/2311093447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"}]': finished 2024-09-21T00:42:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T00:42:38.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:38 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:42:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/2311093447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"}]': finished 2024-09-21T00:42:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T00:42:38.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:38 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/2311093447' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"} : dispatch 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05aa564e-f675-4b5a-8acd-7324f35b015a"}]': finished 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: osdmap e58: 11 total, 10 up, 11 in 2024-09-21T00:42:38.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:38 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:42:39.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:39 smithi123 ceph-mon[34853]: from='client.? 172.21.15.123:0/1751787544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:39.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:39 smithi178 ceph-mon[34888]: from='client.? 172.21.15.123:0/1751787544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:39.454 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:39 smithi016 ceph-mon[30947]: from='client.? 172.21.15.123:0/1751787544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:42:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:40 smithi123 ceph-mon[34853]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:40.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:40 smithi178 ceph-mon[34888]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:40.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:40 smithi016 ceph-mon[30947]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:41.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:41 smithi178 ceph-mon[34888]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:41.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:41 smithi016 ceph-mon[30947]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:41.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:41 smithi123 ceph-mon[34853]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:43.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:43 smithi123 ceph-mon[34853]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:43.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:43 smithi178 ceph-mon[34888]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:43.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:43 smithi016 ceph-mon[30947]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:45.475 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:45 smithi123 ceph-mon[34853]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:45.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:45 smithi016 ceph-mon[30947]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:45.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:45 smithi178 ceph-mon[34888]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:47.548 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:47 smithi123 ceph-mon[34853]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:47.548 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:47 smithi123 ceph-mon[34853]: Deploying daemon osd.10 on smithi123 2024-09-21T00:42:47.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:47 smithi016 ceph-mon[30947]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:47.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:42:47.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:47.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:47 smithi016 ceph-mon[30947]: Deploying daemon osd.10 on smithi123 2024-09-21T00:42:47.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:47 smithi178 ceph-mon[34888]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:47.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:42:47.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:42:47.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:47 smithi178 ceph-mon[34888]: Deploying daemon osd.10 on smithi123 2024-09-21T00:42:49.552 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:49 smithi123 ceph-mon[34853]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:49.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:49 smithi016 ceph-mon[30947]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:49.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:49 smithi178 ceph-mon[34888]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:51.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:51 smithi016 ceph-mon[30947]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:51.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:51 smithi123 ceph-mon[34853]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:51.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:51 smithi178 ceph-mon[34888]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:53.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:53 smithi123 ceph-mon[34853]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:53.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:53.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:53.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:53.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:53 smithi016 ceph-mon[30947]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:53.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:53.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:53.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:53 smithi178 ceph-mon[34888]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:42:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:55.649 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:55 smithi123 ceph-mon[34853]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:55.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:55 smithi016 ceph-mon[30947]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:55.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:55 smithi178 ceph-mon[34888]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.544+0000 7f44b8a0e640 1 -- 172.21.15.123:0/2565239802 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f44b4063800 con 0x7f449c0b6510 2024-09-21T00:42:56.546 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 10 on host 'smithi123' 2024-09-21T00:42:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.546+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 msgr2=0x7f449c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.546+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 0x7f449c0b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005f70 tx=0x7f44a4000bc0 comp rx=0 tx=0).stop 2024-09-21T00:42:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.546+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 msgr2=0x7f44b41030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:42:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.546+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00eaa0 tx=0x7f44ac00ef60 comp rx=0 tx=0).stop 2024-09-21T00:42:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 shutdown_connections 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f449c0b6510 0x7f449c0b8a20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44b4109470 0x7f44b41030c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44b4102550 0x7f44b4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 --2- 172.21.15.123:0/2565239802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44b4101b20 0x7f44b41042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 >> 172.21.15.123:0/2565239802 conn(0x7f44b40fd770 msgr2=0x7f44b41077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 shutdown_connections 2024-09-21T00:42:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T00:42:56.547+0000 7f44b9a10640 1 -- 172.21.15.123:0/2565239802 wait complete. 2024-09-21T00:42:57.279 DEBUG:teuthology.orchestra.run.smithi123:osd.10> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T00:42:57.282 INFO:tasks.cephadm:Deploying osd.11 on smithi178 with /dev/vg_nvme/lv_1... 2024-09-21T00:42:57.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:42:57.538 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:42:57.660 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:57 smithi178 ceph-mon[34888]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:57.660 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:57 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.660 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:57 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.660 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:57 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.660 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:57 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.865 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:57 smithi123 ceph-mon[34853]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:57.865 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:57 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.865 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:57 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.865 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:57 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:57.865 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:57 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:58.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:57 smithi016 ceph-mon[30947]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:58.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:57 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:58.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:57 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:58.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:57 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:58.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:57 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:42:59.203 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:42:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:42:58.973+0000 7f87fcad2640 -1 osd.10 0 log_to_monitors true 2024-09-21T00:42:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:59 smithi178 ceph-mon[34888]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:59 smithi178 ceph-mon[34888]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:42:59.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:42:59 smithi178 ceph-mon[34888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:42:59.915 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:59 smithi123 ceph-mon[34853]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:42:59.915 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:59 smithi123 ceph-mon[34853]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:42:59.915 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:42:59 smithi123 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:43:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:59 smithi016 ceph-mon[30947]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:43:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:59 smithi016 ceph-mon[30947]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:43:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:42:59 smithi016 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:43:00.260 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-21T00:43:00.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2024-09-21T00:43:00.536 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:43:00.557 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:43:00.557 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-mon[34853]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:00.557 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-mon[34853]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:43:00.557 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:00.557 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:00.808 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:00 smithi178 ceph-mon[34888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:43:00.808 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:00 smithi178 ceph-mon[34888]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:00.808 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:00 smithi178 ceph-mon[34888]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:43:00.808 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:00 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:00.808 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:00 smithi178 ceph-mon[34888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:00.937 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:43:00.554+0000 7f87f8a54640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T00:43:00.937 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:43:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:43:00.565+0000 7f87f4852640 -1 osd.10 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:43:01.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:00 smithi016 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:43:01.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:00 smithi016 ceph-mon[30947]: from='osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:01.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:00 smithi016 ceph-mon[30947]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T00:43:01.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:00 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:01.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:00 smithi016 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 -- 172.21.15.178:0/973857730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8102650 msgr2=0x7f6bc8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/973857730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8102650 0x7f6bc8102ac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009900 tx=0x7f6bb802a480 comp rx=0 tx=0).stop 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 -- 172.21.15.178:0/973857730 shutdown_connections 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/973857730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc8104080 0x7f6bc810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/973857730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc81036e0 0x7f6bc8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/973857730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8102650 0x7f6bc8102ac0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 -- 172.21.15.178:0/973857730 >> 172.21.15.178:0/973857730 conn(0x7f6bc80fdfc0 msgr2=0x7f6bc8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 -- 172.21.15.178:0/973857730 shutdown_connections 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.030+0000 7f6bcd63c640 1 -- 172.21.15.178:0/973857730 wait complete. 2024-09-21T00:43:01.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 Processor -- start 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 -- start start 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 0x7f6bc8198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc81036e0 0x7f6bc8199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 0x7f6bc819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810e290 con 0x7f6bc81036e0 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810e110 con 0x7f6bc8102650 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bcd63c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810e410 con 0x7f6bc8104080 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 0x7f6bc819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 0x7f6bc8198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 0x7f6bc819a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:49882/0 (socket says 172.21.15.178:49882) 2024-09-21T00:43:01.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bc77fe640 1 -- 172.21.15.178:0/2203113120 learned_addr learned my addr 172.21.15.178:0/2203113120 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.031+0000 7f6bc67fc640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc81036e0 0x7f6bc8199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 -- 172.21.15.178:0/2203113120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 msgr2=0x7f6bc819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 0x7f6bc819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 -- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc81036e0 msgr2=0x7f6bc8199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc81036e0 0x7f6bc8199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 -- 172.21.15.178:0/2203113120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc819a870 con 0x7f6bc8102650 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bc6ffd640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 0x7f6bc8198ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8006010 tx=0x7f6bb8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8035050 con 0x7f6bc8102650 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc819ab00 con 0x7f6bc8102650 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb8003aa0 con 0x7f6bc8102650 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8038b00 con 0x7f6bc8102650 2024-09-21T00:43:01.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.032+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc806bb60 con 0x7f6bc8102650 2024-09-21T00:43:01.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.033+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc806c520 con 0x7f6bc8102650 2024-09-21T00:43:01.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.034+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6bb8003c50 con 0x7f6bc8102650 2024-09-21T00:43:01.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.035+0000 7f6bbffff640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 0x7f6bb40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:01.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.035+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6414+0+0 (secure 0 0 0) 0x7f6bb8108e00 con 0x7f6bc8102650 2024-09-21T00:43:01.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.036+0000 7f6bc67fc640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 0x7f6bb40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:01.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.036+0000 7f6bc67fc640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 0x7f6bb40b8a20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009bd0 tx=0x7f6bb0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:01.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.038+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bb80cfdf0 con 0x7f6bc8102650 2024-09-21T00:43:01.227 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:01.226+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6bc8109310 con 0x7f6bb40b6510 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi123 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:43:01.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:01 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:01.893 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:43:01.893 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:43:01.893 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:43:01.893 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:01.893 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi123 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.894 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:43:01.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:01 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:02.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi123 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:02.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:43:02.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:01 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:02.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:43:02.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:43:02.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:02.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] boot 2024-09-21T00:43:02.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T00:43:02.628 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:43:03.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:43:03.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:03.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] boot 2024-09-21T00:43:03.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T00:43:03.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:43:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:43:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: osd.10 [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] boot 2024-09-21T00:43:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: osdmap e61: 11 total, 11 up, 11 in 2024-09-21T00:43:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:43:03.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:03 smithi178 ceph-mon[34888]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:03.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:03 smithi178 ceph-mon[34888]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:43:04.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:03 smithi016 ceph-mon[30947]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:04.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:03 smithi016 ceph-mon[30947]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:43:04.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:03 smithi123 ceph-mon[34853]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:04.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:03 smithi123 ceph-mon[34853]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/3066030132' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"}]': finished 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:05.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:04 smithi016 ceph-mon[30947]: from='client.? 172.21.15.178:0/3334794217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:43:05.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:43:05.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/3066030132' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"}]': finished 2024-09-21T00:43:05.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:43:05.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:05.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:04 smithi123 ceph-mon[34853]: from='client.? 172.21.15.178:0/3334794217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:43:05.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:43:05.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/3066030132' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"} : dispatch 2024-09-21T00:43:05.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6769ceec-1b7b-4c94-a9e6-e8780afda9ce"}]': finished 2024-09-21T00:43:05.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T00:43:05.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:05.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:04 smithi178 ceph-mon[34888]: from='client.? 172.21.15.178:0/3334794217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:43:06.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:05 smithi016 ceph-mon[30947]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:06.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:05 smithi123 ceph-mon[34853]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:06.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:05 smithi178 ceph-mon[34888]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:08.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:07 smithi016 ceph-mon[30947]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:43:08.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:07 smithi123 ceph-mon[34853]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:43:08.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:07 smithi178 ceph-mon[34888]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-21T00:43:10.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:09 smithi016 ceph-mon[30947]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:43:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:09 smithi123 ceph-mon[34853]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:43:10.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:09 smithi178 ceph-mon[34888]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:43:11.964 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:11 smithi123 ceph-mon[34853]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:43:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:11 smithi016 ceph-mon[30947]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:43:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:11 smithi178 ceph-mon[34888]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T00:43:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:12 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:43:13.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:12 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:13.010 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:12 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:43:13.010 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:12 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:13.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:12 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:43:13.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:12 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:13.869 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:13 smithi178 ceph-mon[34888]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:43:13.869 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:13 smithi178 ceph-mon[34888]: Deploying daemon osd.11 on smithi178 2024-09-21T00:43:14.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:13 smithi016 ceph-mon[30947]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:43:14.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:13 smithi016 ceph-mon[30947]: Deploying daemon osd.11 on smithi178 2024-09-21T00:43:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:13 smithi123 ceph-mon[34853]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:43:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:13 smithi123 ceph-mon[34853]: Deploying daemon osd.11 on smithi178 2024-09-21T00:43:15.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:15 smithi178 ceph-mon[34888]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T00:43:16.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:15 smithi016 ceph-mon[30947]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T00:43:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:15 smithi123 ceph-mon[34853]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T00:43:17.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:17 smithi178 ceph-mon[34888]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:43:18.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:17 smithi016 ceph-mon[30947]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:43:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:17 smithi123 ceph-mon[34853]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:43:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:18 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:18 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:19.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:18 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:19.964 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:19 smithi178 ceph-mon[34888]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:19 smithi016 ceph-mon[30947]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:19 smithi123 ceph-mon[34853]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:21.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:21 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:22.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:22.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:21 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:21 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.246 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 11 on host 'smithi178' 2024-09-21T00:43:22.246 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.245+0000 7f6bbffff640 1 -- 172.21.15.178:0/2203113120 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6bc8109310 con 0x7f6bb40b6510 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 msgr2=0x7f6bb40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 0x7f6bb40b8a20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009bd0 tx=0x7f6bb0005f90 comp rx=0 tx=0).stop 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 msgr2=0x7f6bc8198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 0x7f6bc8198ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8006010 tx=0x7f6bb8004270 comp rx=0 tx=0).stop 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 shutdown_connections 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f6bb40b6510 0x7f6bb40b8a20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:22.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8104080 0x7f6bc819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:22.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bc81036e0 0x7f6bc8199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:22.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 --2- 172.21.15.178:0/2203113120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bc8102650 0x7f6bc8198ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:22.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 >> 172.21.15.178:0/2203113120 conn(0x7f6bc80fdfc0 msgr2=0x7f6bc8106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:22.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 shutdown_connections 2024-09-21T00:43:22.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:22.248+0000 7f6bcd63c640 1 -- 172.21.15.178:0/2203113120 wait complete. 2024-09-21T00:43:22.958 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:22 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:22.958 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:22 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:22.958 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:22 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:23.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:22 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:23.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:22 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:23.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:22 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:23.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:22 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:23.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:22 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:23.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:22 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:23.286 DEBUG:teuthology.orchestra.run.smithi178:osd.11> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T00:43:23.289 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T00:43:23.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:43:23.562 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:23.950 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:23 smithi016 ceph-mon[30947]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:24.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:23 smithi123 ceph-mon[34853]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:24.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:23 smithi178 ceph-mon[34888]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:24.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/1776393337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0102640 msgr2=0x7fb2e0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:24.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/1776393337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0102640 0x7fb2e0102ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009900 tx=0x7fb2d402a480 comp rx=0 tx=0).stop 2024-09-21T00:43:24.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/1776393337 shutdown_connections 2024-09-21T00:43:24.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/1776393337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0104070 0x7fb2e010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/1776393337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 0x7fb2e0103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/1776393337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0102640 0x7fb2e0102ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/1776393337 >> 172.21.15.16:0/1776393337 conn(0x7fb2e00fdfb0 msgr2=0x7fb2e0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/1776393337 shutdown_connections 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.044+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/1776393337 wait complete. 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 Processor -- start 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 -- start start 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0102640 0x7fb2e006b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 0x7fb2e019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e010e260 con 0x7fb2e0104070 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e010e0e0 con 0x7fb2e01036d0 2024-09-21T00:43:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e6bb1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e010e3e0 con 0x7fb2e0102640 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33070/0 (socket says 172.21.15.16:33070) 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 -- 172.21.15.16:0/2561823476 learned_addr learned my addr 172.21.15.16:0/2561823476 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e494d640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0102640 0x7fb2e006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2dffff640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 0x7fb2e019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 -- 172.21.15.16:0/2561823476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0102640 msgr2=0x7fb2e006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0102640 0x7fb2e006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 -- 172.21.15.16:0/2561823476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 msgr2=0x7fb2e019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 0x7fb2e019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.045+0000 7fb2e514e640 1 -- 172.21.15.16:0/2561823476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e01a1a60 con 0x7fb2e0104070 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2e514e640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800eb10 tx=0x7fb2d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8004b20 con 0x7fb2e0104070 2024-09-21T00:43:24.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d8004cc0 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e01a1d50 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8010670 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.046+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01a21d0 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.047+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e0109820 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.049+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb2d8005020 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.050+0000 7fb2ddffb640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 0x7fb2d00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.050+0000 7fb2e494d640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 0x7fb2d00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.050+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7fb2d80e7230 con 0x7fb2e0104070 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.050+0000 7fb2e494d640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 0x7fb2d00b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000c00 tx=0x7fb2d4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.054+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2d80ae0a0 con 0x7fb2e0104070 2024-09-21T00:43:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.246+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb2e0063ff0 con 0x7fb2e0104070 2024-09-21T00:43:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.246+0000 7fb2ddffb640 1 -- 172.21.15.16:0/2561823476 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7fb2d80b2480 con 0x7fb2e0104070 2024-09-21T00:43:24.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 msgr2=0x7fb2d00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 0x7fb2d00b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000c00 tx=0x7fb2d4031400 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 msgr2=0x7fb2e01a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800eb10 tx=0x7fb2d800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 shutdown_connections 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2d00b6590 0x7fb2d00b8aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e0104070 0x7fb2e01a1240 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2e01036d0 0x7fb2e019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 --2- 172.21.15.16:0/2561823476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e0102640 0x7fb2e006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.248+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 >> 172.21.15.16:0/2561823476 conn(0x7fb2e00fdfb0 msgr2=0x7fb2e01069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.249+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 shutdown_connections 2024-09-21T00:43:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:24.249+0000 7fb2e6bb1640 1 -- 172.21.15.16:0/2561823476 wait complete. 2024-09-21T00:43:24.471 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:43:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:43:24.123+0000 7f114883f640 -1 osd.11 0 log_to_monitors true 2024-09-21T00:43:24.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:24 smithi016 ceph-mon[30947]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:24.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:24 smithi016 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:24.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:24 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2561823476' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:25.001 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726879381,"num_in_osds":12,"osd_in_since":1726879383,"num_remapped_pgs":0} 2024-09-21T00:43:25.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:24 smithi123 ceph-mon[34853]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:25.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:24 smithi123 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:25.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:24 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2561823476' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:25.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:24 smithi178 ceph-mon[34888]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:25.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:24 smithi178 ceph-mon[34888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:43:25.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:24 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2561823476' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:25.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:43:25.744+0000 7f11447c1640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T00:43:25.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:43:25.756+0000 7f11405bf640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:43:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:43:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:43:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:25.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:25 smithi178 ceph-mon[34888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:26.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:43:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:43:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:43:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:26.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:26.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:25 smithi016 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: from='osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:25 smithi123 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]} : dispatch 2024-09-21T00:43:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 -- 172.21.15.16:0/952411240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc109470 msgr2=0x7fb2cc10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/952411240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc109470 0x7fb2cc10b980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009ca0 tx=0x7fb2c402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 -- 172.21.15.16:0/952411240 shutdown_connections 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/952411240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc109470 0x7fb2cc10b980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/952411240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 0x7fb2cc108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/952411240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc06b980 0x7fb2cc106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 -- 172.21.15.16:0/952411240 >> 172.21.15.16:0/952411240 conn(0x7fb2cc0fdfb0 msgr2=0x7fb2cc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 -- 172.21.15.16:0/952411240 shutdown_connections 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.761+0000 7fb2d3a14640 1 -- 172.21.15.16:0/952411240 wait complete. 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 Processor -- start 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 -- start start 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 0x7fb2cc102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 0x7fb2cc1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc10f370 con 0x7fb2cc06b980 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc10f1f0 con 0x7fb2cc109470 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d3a14640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc10f4f0 con 0x7fb2cc1068d0 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d17b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d17b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50608/0 (socket says 172.21.15.16:50608) 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d17b0640 1 -- 172.21.15.16:0/754111377 learned_addr learned my addr 172.21.15.16:0/754111377 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d0faf640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 0x7fb2cc102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.762+0000 7fb2d1fb1640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 0x7fb2cc1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 -- 172.21.15.16:0/754111377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 msgr2=0x7fb2cc102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 0x7fb2cc102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 -- 172.21.15.16:0/754111377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 msgr2=0x7fb2cc1027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 0x7fb2cc1027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 -- 172.21.15.16:0/754111377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc102ed0 con 0x7fb2cc06b980 2024-09-21T00:43:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d1fb1640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 0x7fb2cc1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d17b0640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d950 tx=0x7fb2c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c8009c30 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc1a3fc0 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800f620 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.763+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc1a4360 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.765+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2cc106d20 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.766+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb2c8010460 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.766+0000 7fb2c27fc640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 0x7fb2b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.766+0000 7fb2d0faf640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 0x7fb2b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.766+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7fb2c80e6aa0 con 0x7fb2cc06b980 2024-09-21T00:43:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.767+0000 7fb2d0faf640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 0x7fb2b80b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009bd0 tx=0x7fb2bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.771+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2c80ad7d0 con 0x7fb2cc06b980 2024-09-21T00:43:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.963+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb2cc063fc0 con 0x7fb2cc06b980 2024-09-21T00:43:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.963+0000 7fb2c27fc640 1 -- 172.21.15.16:0/754111377 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fb2c8009de0 con 0x7fb2cc06b980 2024-09-21T00:43:26.964 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: Detected new or changed devices on smithi178 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:26.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:26.966 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:26.966 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:26.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 msgr2=0x7fb2b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 0x7fb2b80b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009bd0 tx=0x7fb2bc005f90 comp rx=0 tx=0).stop 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 msgr2=0x7fb2cc1039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d950 tx=0x7fb2c800de10 comp rx=0 tx=0).stop 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 shutdown_connections 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb2b80b6510 0x7fb2b80b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2cc109470 0x7fb2cc1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2cc1068d0 0x7fb2cc102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 --2- 172.21.15.16:0/754111377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2cc06b980 0x7fb2cc1039c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 >> 172.21.15.16:0/754111377 conn(0x7fb2cc0fdfb0 msgr2=0x7fb2cc104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 shutdown_connections 2024-09-21T00:43:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:26.966+0000 7fb2d3a14640 1 -- 172.21.15.16:0/754111377 wait complete. 2024-09-21T00:43:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:43:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: Detected new or changed devices on smithi178 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:27.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:27.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: Detected new or changed devices on smithi178 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:43:27.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-21T00:43:27.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:27.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:27.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:27.741 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":67,"num_osds":12,"num_up_osds":12,"osd_up_since":1726879406,"num_in_osds":12,"osd_in_since":1726879383,"num_remapped_pgs":0} 2024-09-21T00:43:27.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:43:28.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: purged_snaps scrub starts 2024-09-21T00:43:28.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: purged_snaps scrub ok 2024-09-21T00:43:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] boot 2024-09-21T00:43:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:43:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:27 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/754111377' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: purged_snaps scrub starts 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: purged_snaps scrub ok 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] boot 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:27 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/754111377' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: purged_snaps scrub starts 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: purged_snaps scrub ok 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: osd.11 [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] boot 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:43:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:27 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/754111377' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:43:28.045 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:28.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 -- 172.21.15.16:0/1705437453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77541049e0 msgr2=0x7f7754104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:28.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 --2- 172.21.15.16:0/1705437453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77541049e0 0x7f7754104df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7744009900 tx=0x7f774402a410 comp rx=0 tx=0).stop 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 -- 172.21.15.16:0/1705437453 shutdown_connections 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 --2- 172.21.15.16:0/1705437453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775410de40 0x7f7754110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 --2- 172.21.15.16:0/1705437453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7754105330 0x7f775410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 --2- 172.21.15.16:0/1705437453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77541049e0 0x7f7754104df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 -- 172.21.15.16:0/1705437453 >> 172.21.15.16:0/1705437453 conn(0x7f7754079750 msgr2=0x7f7754079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 -- 172.21.15.16:0/1705437453 shutdown_connections 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 -- 172.21.15.16:0/1705437453 wait complete. 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.518+0000 7f7759116640 1 Processor -- start 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 -- start start 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 0x7f775419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7754105330 0x7f775419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:28.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7754113ac0 con 0x7f775410de40 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7754113940 con 0x7f7754105330 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7759116640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7754113c40 con 0x7f77541049e0 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50614/0 (socket says 172.21.15.16:50614) 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 -- 172.21.15.16:0/2895928336 learned_addr learned my addr 172.21.15.16:0/2895928336 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775259c640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7754105330 0x7f775419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f7752d9d640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 0x7f775419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 -- 172.21.15.16:0/2895928336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 msgr2=0x7f775419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 0x7f775419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 -- 172.21.15.16:0/2895928336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7754105330 msgr2=0x7f775419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.519+0000 7f775359e640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7754105330 0x7f775419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f775359e640 1 -- 172.21.15.16:0/2895928336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77541a0480 con 0x7f775410de40 2024-09-21T00:43:28.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f7752d9d640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 0x7f775419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f775359e640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f774c009fd0 tx=0x7f774c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c017070 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77541a0770 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77541a6ed0 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f774c003e20 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.520+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c010460 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.521+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77400052c0 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.524+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f774c003970 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.524+0000 7f773bfff640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 0x7f773c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.525+0000 7f7752d9d640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 0x7f773c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.525+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f774c0e69a0 con 0x7f775410de40 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.525+0000 7f7752d9d640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 0x7f773c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744032cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:28.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.528+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f774c0ad6d0 con 0x7f775410de40 2024-09-21T00:43:28.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.717+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7740005880 con 0x7f775410de40 2024-09-21T00:43:28.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.718+0000 7f773bfff640 1 -- 172.21.15.16:0/2895928336 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18482 (secure 0 0 0) 0x7f774c0b1ab0 con 0x7f775410de40 2024-09-21T00:43:28.719 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:28.719 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":68,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:43:27.938856+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.720+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 msgr2=0x7f773c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.720+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 0x7f773c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744032cc0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.720+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 msgr2=0x7f775419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.720+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f774c009fd0 tx=0x7f774c00b260 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 shutdown_connections 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f773c0b6510 0x7f773c0b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f775410de40 0x7f775419fd50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7754105330 0x7f775419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 --2- 172.21.15.16:0/2895928336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77541049e0 0x7f775419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 >> 172.21.15.16:0/2895928336 conn(0x7f7754079750 msgr2=0x7f7754100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 shutdown_connections 2024-09-21T00:43:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:28.721+0000 7f7759116640 1 -- 172.21.15.16:0/2895928336 wait complete. 2024-09-21T00:43:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:28 smithi016 ceph-mon[30947]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:43:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:28 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2895928336' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:43:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:28 smithi123 ceph-mon[34853]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:43:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:28 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2895928336' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:43:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:28 smithi178 ceph-mon[34888]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T00:43:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:28 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2895928336' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:43:29.465 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:39:36.636978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:43:29.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T00:43:29.763 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:30.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:29 smithi016 ceph-mon[30947]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.222+0000 7fe4ecce7640 1 -- 172.21.15.16:0/2430995811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e8108d10 msgr2=0x7fe4e810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.222+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/2430995811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e8108d10 0x7fe4e810f540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009ca0 tx=0x7fe4e002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.222+0000 7fe4ecce7640 1 -- 172.21.15.16:0/2430995811 shutdown_connections 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/2430995811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e8108d10 0x7fe4e810f540 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/2430995811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e81083c0 0x7fe4e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/2430995811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8102a80 0x7fe4e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 -- 172.21.15.16:0/2430995811 >> 172.21.15.16:0/2430995811 conn(0x7fe4e8079740 msgr2=0x7fe4e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 -- 172.21.15.16:0/2430995811 shutdown_connections 2024-09-21T00:43:30.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 -- 172.21.15.16:0/2430995811 wait complete. 2024-09-21T00:43:30.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.223+0000 7fe4ecce7640 1 Processor -- start 2024-09-21T00:43:30.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 -- start start 2024-09-21T00:43:30.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e8102a80 0x7fe4e80ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 0x7fe4e8100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8112980 con 0x7fe4e81083c0 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8112800 con 0x7fe4e8108d10 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4ecce7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8112b00 con 0x7fe4e8102a80 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50636/0 (socket says 172.21.15.16:50636) 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e5d9b640 1 -- 172.21.15.16:0/6463523 learned_addr learned my addr 172.21.15.16:0/6463523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 0x7fe4e8100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e659c640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e8102a80 0x7fe4e80ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 -- 172.21.15.16:0/6463523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e8102a80 msgr2=0x7fe4e80ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e8102a80 0x7fe4e80ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 -- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 msgr2=0x7fe4e80ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e6d9d640 1 -- 172.21.15.16:0/6463523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e81a87a0 con 0x7fe4e8108d10 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.224+0000 7fe4e5d9b640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4e6d9d640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 0x7fe4e8100110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4e002ade0 tx=0x7fe4e00316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0003b70 con 0x7fe4e8108d10 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e81a8a30 con 0x7fe4e8108d10 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4e0003d10 con 0x7fe4e8108d10 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e002f9e0 con 0x7fe4e8108d10 2024-09-21T00:43:30.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.225+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81a8f70 con 0x7fe4e8108d10 2024-09-21T00:43:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.226+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e8103d00 con 0x7fe4e8108d10 2024-09-21T00:43:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.227+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fe4e0004b40 con 0x7fe4e8108d10 2024-09-21T00:43:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.228+0000 7fe4d77fe640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 0x7fe4d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.228+0000 7fe4e659c640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 0x7fe4d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.228+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fe4e0108210 con 0x7fe4e8108d10 2024-09-21T00:43:30.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.229+0000 7fe4e659c640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 0x7fe4d00b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4e81010e0 tx=0x7fe4d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:30.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.231+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4e00ceea0 con 0x7fe4e8108d10 2024-09-21T00:43:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:29 smithi123 ceph-mon[34853]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:30.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:29 smithi178 ceph-mon[34888]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.423+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe4e8100990 con 0x7fe4e8108d10 2024-09-21T00:43:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.424+0000 7fe4d77fe640 1 -- 172.21.15.16:0/6463523 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fe4e00d3280 con 0x7fe4e8108d10 2024-09-21T00:43:30.425 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 msgr2=0x7fe4d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 0x7fe4d00b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4e81010e0 tx=0x7fe4d8005f90 comp rx=0 tx=0).stop 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 msgr2=0x7fe4e8100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 0x7fe4e8100110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe4e002ade0 tx=0x7fe4e00316f0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 shutdown_connections 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d00b6510 0x7fe4d00b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4e8108d10 0x7fe4e8100110 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4e81083c0 0x7fe4e80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 --2- 172.21.15.16:0/6463523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e8102a80 0x7fe4e80ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 >> 172.21.15.16:0/6463523 conn(0x7fe4e8079740 msgr2=0x7fe4e8101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 shutdown_connections 2024-09-21T00:43:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:30.426+0000 7fe4ecce7640 1 -- 172.21.15.16:0/6463523 wait complete. 2024-09-21T00:43:31.215 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:30 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/6463523' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:43:31.251 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:30 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/6463523' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:43:31.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:30 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/6463523' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:43:31.286 INFO:tasks.cephadm:Adding mds.a on smithi016 2024-09-21T00:43:31.286 INFO:tasks.cephadm:Adding mds.d on smithi016 2024-09-21T00:43:31.286 INFO:tasks.cephadm:Adding mds.g on smithi016 2024-09-21T00:43:31.286 INFO:tasks.cephadm:Adding mds.j on smithi016 2024-09-21T00:43:31.286 INFO:tasks.cephadm:Adding mds.b on smithi123 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.e on smithi123 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.h on smithi123 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.k on smithi123 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.c on smithi178 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.f on smithi178 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.i on smithi178 2024-09-21T00:43:31.287 INFO:tasks.cephadm:Adding mds.l on smithi178 2024-09-21T00:43:31.287 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l' 2024-09-21T00:43:31.546 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:43:32.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 -- 172.21.15.178:0/319347136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6460109470 msgr2=0x7f646010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:32.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 --2- 172.21.15.178:0/319347136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6460109470 0x7f646010b980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6458009ca0 tx=0x7f645802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 -- 172.21.15.178:0/319347136 shutdown_connections 2024-09-21T00:43:32.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 --2- 172.21.15.178:0/319347136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6460109470 0x7f646010b980 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 --2- 172.21.15.178:0/319347136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460106930 0x7f6460108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 --2- 172.21.15.178:0/319347136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f646006b920 0x7f64601063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 -- 172.21.15.178:0/319347136 >> 172.21.15.178:0/319347136 conn(0x7f64600fdfb0 msgr2=0x7f6460100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 -- 172.21.15.178:0/319347136 shutdown_connections 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.027+0000 7f6464fed640 1 -- 172.21.15.178:0/319347136 wait complete. 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 Processor -- start 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 -- start start 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6460106930 0x7f646019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 0x7f646019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f646010f380 con 0x7f6460109470 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f646010f200 con 0x7f6460106930 2024-09-21T00:43:32.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f6464fed640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f646010f500 con 0x7f646006b920 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f645e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f645e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:56942/0 (socket says 172.21.15.178:56942) 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.028+0000 7f645e59c640 1 -- 172.21.15.178:0/3793469534 learned_addr learned my addr 172.21.15.178:0/3793469534 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645dd9b640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6460106930 0x7f646019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645ed9d640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 0x7f646019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 -- 172.21.15.178:0/3793469534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6460106930 msgr2=0x7f646019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6460106930 0x7f646019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 -- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 msgr2=0x7f646019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 0x7f646019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 -- 172.21.15.178:0/3793469534 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646019b980 con 0x7f646006b920 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645ed9d640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 0x7f646019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f645e59c640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f645000d770 tx=0x7f645000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:32.033 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450017070 con 0x7f646006b920 2024-09-21T00:43:32.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646019bc70 con 0x7f646006b920 2024-09-21T00:43:32.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64601a2370 con 0x7f646006b920 2024-09-21T00:43:32.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64500054d0 con 0x7f646006b920 2024-09-21T00:43:32.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.029+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450004c30 con 0x7f646006b920 2024-09-21T00:43:32.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.030+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6460106d40 con 0x7f646006b920 2024-09-21T00:43:32.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.032+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6450004dd0 con 0x7f646006b920 2024-09-21T00:43:32.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.033+0000 7f64577fe640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:32.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.033+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f64500e6d50 con 0x7f646006b920 2024-09-21T00:43:32.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.033+0000 7f645dd9b640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:32.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.034+0000 7f645dd9b640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 0x7f644c0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f644800bbe0 tx=0x7f644800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:32.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.040+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64500ada80 con 0x7f646006b920 2024-09-21T00:43:32.231 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.231+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}) -- 0x7f6460063900 con 0x7f644c0b6510 2024-09-21T00:43:32.232 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:31 smithi178 ceph-mon[34888]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:32.240 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.240+0000 7f64577fe640 1 -- 172.21.15.178:0/3793469534 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6460063900 con 0x7f644c0b6510 2024-09-21T00:43:32.240 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mds.all update... 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 msgr2=0x7f644c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 0x7f644c0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f644800bbe0 tx=0x7f644800b390 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 msgr2=0x7f6460199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f645000d770 tx=0x7f645000dc30 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 shutdown_connections 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460109470 0x7f646019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6460106930 0x7f646019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 --2- 172.21.15.178:0/3793469534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646006b920 0x7f6460199f50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:32.243 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 >> 172.21.15.178:0/3793469534 conn(0x7f64600fdfb0 msgr2=0x7f6460104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:32.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 shutdown_connections 2024-09-21T00:43:32.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-21T00:43:32.242+0000 7f6464fed640 1 -- 172.21.15.178:0/3793469534 wait complete. 2024-09-21T00:43:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:31 smithi016 ceph-mon[30947]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:32.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:31 smithi123 ceph-mon[34853]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:33.052 DEBUG:teuthology.orchestra.run.smithi016:mds.a> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T00:43:33.055 DEBUG:teuthology.orchestra.run.smithi016:mds.d> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T00:43:33.099 DEBUG:teuthology.orchestra.run.smithi016:mds.g> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T00:43:33.144 DEBUG:teuthology.orchestra.run.smithi016:mds.j> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T00:43:33.187 DEBUG:teuthology.orchestra.run.smithi123:mds.b> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T00:43:33.189 DEBUG:teuthology.orchestra.run.smithi123:mds.e> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T00:43:33.232 DEBUG:teuthology.orchestra.run.smithi123:mds.h> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T00:43:33.275 DEBUG:teuthology.orchestra.run.smithi123:mds.k> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:33.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:33.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:33 smithi178 ceph-mon[34888]: Deploying daemon mds.l on smithi178 2024-09-21T00:43:33.318 DEBUG:teuthology.orchestra.run.smithi178:mds.c> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T00:43:33.320 DEBUG:teuthology.orchestra.run.smithi178:mds.f> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T00:43:33.364 DEBUG:teuthology.orchestra.run.smithi178:mds.i> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T00:43:33.407 DEBUG:teuthology.orchestra.run.smithi178:mds.l> sudo journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T00:43:33.450 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T00:43:33.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:33.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:33.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-09-21T00:43:33.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:33 smithi016 ceph-mon[30947]: Deploying daemon mds.l on smithi178 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:33.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:33.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:33 smithi123 ceph-mon[34853]: Deploying daemon mds.l on smithi178 2024-09-21T00:43:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:34.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 -- 172.21.15.16:0/943319659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c1083a0 msgr2=0x7fdd8c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:34.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/943319659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c1087b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009900 tx=0x7fdd7402a410 comp rx=0 tx=0).stop 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 -- 172.21.15.16:0/943319659 shutdown_connections 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/943319659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/943319659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c1087b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/943319659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 -- 172.21.15.16:0/943319659 >> 172.21.15.16:0/943319659 conn(0x7fdd8c079730 msgr2=0x7fdd8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 -- 172.21.15.16:0/943319659 shutdown_connections 2024-09-21T00:43:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.163+0000 7fdd90bb8640 1 -- 172.21.15.16:0/943319659 wait complete. 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.164+0000 7fdd90bb8640 1 Processor -- start 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.164+0000 7fdd90bb8640 1 -- start start 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.164+0000 7fdd90bb8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.164+0000 7fdd90bb8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd90bb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd90bb8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c113a80 con 0x7fdd8c108cf0 2024-09-21T00:43:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd90bb8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c113900 con 0x7fdd8c102a60 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd90bb8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c113c00 con 0x7fdd8c1083a0 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41688/0 (socket says 172.21.15.16:41688) 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd89d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 -- 172.21.15.16:0/1202473448 learned_addr learned my addr 172.21.15.16:0/1202473448 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8a59c640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 -- 172.21.15.16:0/1202473448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c1083a0 msgr2=0x7fdd8c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 -- 172.21.15.16:0/1202473448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 msgr2=0x7fdd8c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 -- 172.21.15.16:0/1202473448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c1a03e0 con 0x7fdd8c108cf0 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8a59c640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:43:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd8ad9d640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009fd0 tx=0x7fdd8400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84017070 con 0x7fdd8c108cf0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd84003e20 con 0x7fdd8c108cf0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.165+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c1a06d0 con 0x7fdd8c108cf0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.166+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84010460 con 0x7fdd8c108cf0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.166+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c1a6e30 con 0x7fdd8c108cf0 2024-09-21T00:43:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.167+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c103ce0 con 0x7fdd8c108cf0 2024-09-21T00:43:34.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.169+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fdd84003970 con 0x7fdd8c108cf0 2024-09-21T00:43:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.170+0000 7fdd837fe640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 0x7fdd780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.170+0000 7fdd8a59c640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 0x7fdd780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.170+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fdd840e6c70 con 0x7fdd8c108cf0 2024-09-21T00:43:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.171+0000 7fdd8a59c640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 0x7fdd780b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0058c0 tx=0x7fdd7c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.173+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd840ad900 con 0x7fdd8c108cf0 2024-09-21T00:43:34.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.401+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd8c10aae0 con 0x7fdd8c108cf0 2024-09-21T00:43:34.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.402+0000 7fdd837fe640 1 -- 172.21.15.16:0/1202473448 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fdd840b1ce0 con 0x7fdd8c108cf0 2024-09-21T00:43:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:34.403 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":1,"btime":"2024-09-21T00:35:57:524567+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T00:43:34.403 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 1 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 msgr2=0x7fdd780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 0x7fdd780b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0058c0 tx=0x7fdd7c005850 comp rx=0 tx=0).stop 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 msgr2=0x7fdd8c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009fd0 tx=0x7fdd8400b260 comp rx=0 tx=0).stop 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 shutdown_connections 2024-09-21T00:43:34.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd780b6510 0x7fdd780b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd8c108cf0 0x7fdd8c19fcb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd8c1083a0 0x7fdd8c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 --2- 172.21.15.16:0/1202473448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c102a60 0x7fdd8c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 >> 172.21.15.16:0/1202473448 conn(0x7fdd8c079730 msgr2=0x7fdd8c1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 shutdown_connections 2024-09-21T00:43:34.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:34.404+0000 7fdd90bb8640 1 -- 172.21.15.16:0/1202473448 wait complete. 2024-09-21T00:43:34.787 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:34 smithi178 systemd[1]: Starting Ceph mds.l for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:35.145 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:34 smithi178 podman[63403]: 2024-09-21 00:43:34.79034607 +0000 UTC m=+0.015835612 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:35.145 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:34 smithi178 podman[63403]: 2024-09-21 00:43:34.908182719 +0000 UTC m=+0.133672299 container create 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T00:43:35.145 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 podman[63403]: 2024-09-21 00:43:35.143946888 +0000 UTC m=+0.369436420 container init 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T00:43:35.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:35.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1202473448' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:35.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6832/2278158780,v1:172.21.15.178:6833/2278158780] up:boot 2024-09-21T00:43:35.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: fsmap 1 up:standby 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 podman[63403]: 2024-09-21 00:43:35.147007883 +0000 UTC m=+0.372497421 container start 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-mds[63422]: -- 172.21.15.178:0/4149682447 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b68b6b860 con 0x559b6cd13180 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: starting mds.l at 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 bash[63403]: 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd 2024-09-21T00:43:35.538 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:43:35 smithi178 systemd[1]: Started Ceph mds.l for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1202473448' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6832/2278158780,v1:172.21.15.178:6833/2278158780] up:boot 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: fsmap 1 up:standby 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:43:35.707 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:35 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:35.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:35.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1202473448' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:35.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6832/2278158780,v1:172.21.15.178:6833/2278158780] up:boot 2024-09-21T00:43:35.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: fsmap 1 up:standby 2024-09-21T00:43:35.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:43:35.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:35 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.745 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.746 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.746 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:36.746 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:36.746 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:36.746 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:36 smithi123 ceph-mon[34853]: Deploying daemon mds.k on smithi123 2024-09-21T00:43:36.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:36.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:36.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:36.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:36 smithi016 ceph-mon[30947]: Deploying daemon mds.k on smithi123 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:36.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:36 smithi178 ceph-mon[34888]: Deploying daemon mds.k on smithi123 2024-09-21T00:43:37.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:37.490 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:37 smithi123 ceph-mon[34853]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:37.648 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:37.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:37 smithi016 ceph-mon[30947]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:37.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:37 smithi178 ceph-mon[34888]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:38.270 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:43:37 smithi123 systemd[1]: Started Ceph mds.k for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 -- 172.21.15.16:0/2231191407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6310109e00 msgr2=0x7f6310110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 --2- 172.21.15.16:0/2231191407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6310109e00 0x7f6310110630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6308009ca0 tx=0x7f630802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 -- 172.21.15.16:0/2231191407 shutdown_connections 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 --2- 172.21.15.16:0/2231191407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6310109e00 0x7f6310110630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 --2- 172.21.15.16:0/2231191407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63101094b0 0x7f63101098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 --2- 172.21.15.16:0/2231191407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f6310103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 -- 172.21.15.16:0/2231191407 >> 172.21.15.16:0/2231191407 conn(0x7f631007b910 msgr2=0x7f631007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 -- 172.21.15.16:0/2231191407 shutdown_connections 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.275+0000 7f6314cd6640 1 -- 172.21.15.16:0/2231191407 wait complete. 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 Processor -- start 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 -- start start 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f631019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6310109e00 0x7f63101a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6310113ac0 con 0x7f63101094b0 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6310113940 con 0x7f6310109e00 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6314cd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6310113c40 con 0x7f6310103bc0 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6307fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6307fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41706/0 (socket says 172.21.15.16:41706) 2024-09-21T00:43:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f6307fff640 1 -- 172.21.15.16:0/3598725751 learned_addr learned my addr 172.21.15.16:0/3598725751 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f630ed9d640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6310109e00 0x7f63101a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.276+0000 7f630e59c640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f631019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 -- 172.21.15.16:0/3598725751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 msgr2=0x7f631019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f631019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 -- 172.21.15.16:0/3598725751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6310109e00 msgr2=0x7f63101a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6310109e00 0x7f63101a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 -- 172.21.15.16:0/3598725751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63101a2640 con 0x7f63101094b0 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f630e59c640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f631019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:43:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6307fff640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e9f0 tx=0x7f62f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f800ccc0 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f80108e0 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101a2930 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8018860 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.277+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a9090 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.278+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6310103fd0 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.280+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f62f8010430 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.280+0000 7f63077fe640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 0x7f62fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.281+0000 7f630e59c640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 0x7f62fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.281+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f62f80e70e0 con 0x7f63101094b0 2024-09-21T00:43:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.281+0000 7f630e59c640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 0x7f62fc0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6300009c20 tx=0x7f6300005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.285+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62f80add70 con 0x7f63101094b0 2024-09-21T00:43:38.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.530+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63101a9370 con 0x7f63101094b0 2024-09-21T00:43:38.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.531+0000 7f63077fe640 1 -- 172.21.15.16:0/3598725751 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f62f80b2150 con 0x7f63101094b0 2024-09-21T00:43:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"btime":"2024-09-21T00:43:38:314282+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T00:43:38.533 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-09-21T00:43:38.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 msgr2=0x7f62fc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:38.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 0x7f62fc0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6300009c20 tx=0x7f6300005f90 comp rx=0 tx=0).stop 2024-09-21T00:43:38.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 msgr2=0x7f631019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:38.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e9f0 tx=0x7f62f800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 shutdown_connections 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62fc0b6590 0x7f62fc0b8aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6310109e00 0x7f63101a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63101094b0 0x7f631019cc70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 --2- 172.21.15.16:0/3598725751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6310103bc0 0x7f631019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 >> 172.21.15.16:0/3598725751 conn(0x7f631007b910 msgr2=0x7f6310107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 shutdown_connections 2024-09-21T00:43:38.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:38.533+0000 7f6314cd6640 1 -- 172.21.15.16:0/3598725751 wait complete. 2024-09-21T00:43:39.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: Deploying daemon mds.j on smithi016 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6832/2611682237,v1:172.21.15.123:6833/2611682237] up:boot 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: fsmap 2 up:standby 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:43:39.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:39 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3598725751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:39.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: Deploying daemon mds.j on smithi016 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6832/2611682237,v1:172.21.15.123:6833/2611682237] up:boot 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: fsmap 2 up:standby 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:43:39.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:39 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3598725751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: Deploying daemon mds.j on smithi016 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6832/2611682237,v1:172.21.15.123:6833/2611682237] up:boot 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: fsmap 2 up:standby 2024-09-21T00:43:39.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:43:39.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:39 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3598725751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:41.165 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:40 smithi016 systemd[1]: Starting Ceph mds.j for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:41.445 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:41 smithi016 ceph-mon[30947]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:41.445 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 podman[70890]: 2024-09-21 00:43:41.067039833 +0000 UTC m=+0.016299964 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:41.446 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 podman[70890]: 2024-09-21 00:43:41.192364931 +0000 UTC m=+0.141625095 container create fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-21T00:43:41.446 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 podman[70890]: 2024-09-21 00:43:41.445153388 +0000 UTC m=+0.394413511 container init fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:43:41.759 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 podman[70890]: 2024-09-21 00:43:41.448429082 +0000 UTC m=+0.397689205 container start fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T00:43:41.759 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 ceph-mds[70910]: -- 172.21.15.16:0/2107263685 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597cb519860 con 0x5597cf6c1600 2024-09-21T00:43:41.760 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j[70906]: starting mds.j at 2024-09-21T00:43:41.760 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 bash[70890]: fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 2024-09-21T00:43:41.760 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:43:41 smithi016 systemd[1]: Started Ceph mds.j for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:41.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:41 smithi123 ceph-mon[34853]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:41.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:41 smithi178 ceph-mon[34888]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:41.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:43.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: Deploying daemon mds.d on smithi016 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6834/4060683495,v1:172.21.15.16:6835/4060683495] up:boot 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: fsmap 3 up:standby 2024-09-21T00:43:43.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:42 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: Deploying daemon mds.d on smithi016 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6834/4060683495,v1:172.21.15.16:6835/4060683495] up:boot 2024-09-21T00:43:43.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: fsmap 3 up:standby 2024-09-21T00:43:43.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:42 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: Deploying daemon mds.d on smithi016 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6834/4060683495,v1:172.21.15.16:6835/4060683495] up:boot 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: fsmap 3 up:standby 2024-09-21T00:43:43.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:42 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:43:43.160 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:43.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.658+0000 7fab34a61640 1 -- 172.21.15.16:0/2247427833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab301049c0 msgr2=0x7fab30104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:43.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.658+0000 7fab34a61640 1 --2- 172.21.15.16:0/2247427833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab301049c0 0x7fab30104dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab20009900 tx=0x7fab2002a410 comp rx=0 tx=0).stop 2024-09-21T00:43:43.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 -- 172.21.15.16:0/2247427833 shutdown_connections 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 --2- 172.21.15.16:0/2247427833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 0x7fab30110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 --2- 172.21.15.16:0/2247427833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab30105310 0x7fab3010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 --2- 172.21.15.16:0/2247427833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab301049c0 0x7fab30104dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 -- 172.21.15.16:0/2247427833 >> 172.21.15.16:0/2247427833 conn(0x7fab30079730 msgr2=0x7fab30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 -- 172.21.15.16:0/2247427833 shutdown_connections 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.659+0000 7fab34a61640 1 -- 172.21.15.16:0/2247427833 wait complete. 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 Processor -- start 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 -- start start 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab301049c0 0x7fab30102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 0x7fab30103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:43.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fab30113aa0 con 0x7fab30105310 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab30113920 con 0x7fab3010de20 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab34a61640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fab30113c20 con 0x7fab301049c0 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41732/0 (socket says 172.21.15.16:41732) 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab2dd9b640 1 -- 172.21.15.16:0/3285586632 learned_addr learned my addr 172.21.15.16:0/3285586632 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab2e59c640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab301049c0 0x7fab30102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.660+0000 7fab2ed9d640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 0x7fab30103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 -- 172.21.15.16:0/3285586632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab301049c0 msgr2=0x7fab30102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab301049c0 0x7fab30102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 -- 172.21.15.16:0/3285586632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 msgr2=0x7fab30103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 0x7fab30103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 -- 172.21.15.16:0/3285586632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab301a8810 con 0x7fab30105310 2024-09-21T00:43:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab2dd9b640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d750 tx=0x7fab2400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24017070 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301a8b00 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab240054d0 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.661+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24004c30 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.662+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab301a9040 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.663+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3006c1e0 con 0x7fab30105310 2024-09-21T00:43:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.664+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fab24004dd0 con 0x7fab30105310 2024-09-21T00:43:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.665+0000 7fab1f7fe640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 0x7fab180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.665+0000 7fab2e59c640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 0x7fab180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.665+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fab240e6ba0 con 0x7fab30105310 2024-09-21T00:43:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.666+0000 7fab2e59c640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 0x7fab180b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab20009230 tx=0x7fab20031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:43.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.672+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab240b1cb0 con 0x7fab30105310 2024-09-21T00:43:43.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:43 smithi016 ceph-mon[30947]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:43.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.925+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab30103a00 con 0x7fab30105310 2024-09-21T00:43:43.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.925+0000 7fab1f7fe640 1 -- 172.21.15.16:0/3285586632 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fab240b6bf0 con 0x7fab30105310 2024-09-21T00:43:43.927 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:43.927 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":4,"btime":"2024-09-21T00:43:42:298965+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T00:43:43.927 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 4 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 msgr2=0x7fab180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 0x7fab180b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab20009230 tx=0x7fab20031400 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 msgr2=0x7fab30102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d750 tx=0x7fab2400dc10 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 shutdown_connections 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab180b6510 0x7fab180b8a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab3010de20 0x7fab30103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab30105310 0x7fab30102c40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 --2- 172.21.15.16:0/3285586632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab301049c0 0x7fab30102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 >> 172.21.15.16:0/3285586632 conn(0x7fab30079730 msgr2=0x7fab301079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 shutdown_connections 2024-09-21T00:43:43.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:43.928+0000 7fab34a61640 1 -- 172.21.15.16:0/3285586632 wait complete. 2024-09-21T00:43:44.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:43 smithi123 ceph-mon[34853]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:43 smithi178 ceph-mon[34888]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:44.652 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:44 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3285586632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:45.009 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:43:44 smithi016 systemd[1]: Started Ceph mds.d for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:45.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:44 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3285586632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:45.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:44 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3285586632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:46.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: Deploying daemon mds.e on smithi123 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6836/220014269,v1:172.21.15.16:6837/220014269] up:boot 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: fsmap 4 up:standby 2024-09-21T00:43:46.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:45 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: Deploying daemon mds.e on smithi123 2024-09-21T00:43:46.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6836/220014269,v1:172.21.15.16:6837/220014269] up:boot 2024-09-21T00:43:46.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: fsmap 4 up:standby 2024-09-21T00:43:46.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:45 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: Deploying daemon mds.e on smithi123 2024-09-21T00:43:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6836/220014269,v1:172.21.15.16:6837/220014269] up:boot 2024-09-21T00:43:46.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: fsmap 4 up:standby 2024-09-21T00:43:46.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:45 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:43:46.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:47.186 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:46 smithi123 systemd[1]: Starting Ceph mds.e for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:47.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 -- 172.21.15.16:0/2100530740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b0108cf0 msgr2=0x7fb3b010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2100530740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b0108cf0 0x7fb3b010f520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009900 tx=0x7fb3a802a410 comp rx=0 tx=0).stop 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 -- 172.21.15.16:0/2100530740 shutdown_connections 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2100530740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b0108cf0 0x7fb3b010f520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2100530740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b01083a0 0x7fb3b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2100530740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 -- 172.21.15.16:0/2100530740 >> 172.21.15.16:0/2100530740 conn(0x7fb3b0079730 msgr2=0x7fb3b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 -- 172.21.15.16:0/2100530740 shutdown_connections 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.411+0000 7fb3b512d640 1 -- 172.21.15.16:0/2100530740 wait complete. 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 Processor -- start 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 -- start start 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:47.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b0108cf0 0x7fb3b019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0112960 con 0x7fb3b01083a0 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b01127e0 con 0x7fb3b0102a60 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3b512d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0112ae0 con 0x7fb3b0108cf0 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3ae59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3ae59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53346/0 (socket says 172.21.15.16:53346) 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.412+0000 7fb3ae59c640 1 -- 172.21.15.16:0/2243346539 learned_addr learned my addr 172.21.15.16:0/2243346539 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3af59e640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b0108cf0 0x7fb3b019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3aed9d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 -- 172.21.15.16:0/2243346539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b0108cf0 msgr2=0x7fb3b019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:47.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b0108cf0 0x7fb3b019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 -- 172.21.15.16:0/2243346539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 msgr2=0x7fb3b019b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b019b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 -- 172.21.15.16:0/2243346539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b01a64a0 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3aed9d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3ae59c640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400d770 tx=0x7fb3a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4017070 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a4009c30 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b01a6790 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400f620 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.413+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b01a6cd0 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.415+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b0102e70 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.416+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb3a401a070 con 0x7fb3b01083a0 2024-09-21T00:43:47.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.417+0000 7fb397fff640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 0x7fb3980b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:47.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.417+0000 7fb3aed9d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 0x7fb3980b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:47.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.417+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb3a40e6970 con 0x7fb3b01083a0 2024-09-21T00:43:47.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.418+0000 7fb3aed9d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 0x7fb3980b8a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006b9c0 tx=0x7fb3a0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:47.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.422+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3a40ad6a0 con 0x7fb3b01083a0 2024-09-21T00:43:47.467 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 podman[62664]: 2024-09-21 00:43:47.088974325 +0000 UTC m=+0.016085596 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:47.468 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 podman[62664]: 2024-09-21 00:43:47.214857456 +0000 UTC m=+0.141968773 container create 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T00:43:47.468 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 podman[62664]: 2024-09-21 00:43:47.467373379 +0000 UTC m=+0.394484663 container init 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-21T00:43:47.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.654+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3b002e640 con 0x7fb3b01083a0 2024-09-21T00:43:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.655+0000 7fb397fff640 1 -- 172.21.15.16:0/2243346539 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fb3a40b1a80 con 0x7fb3b01083a0 2024-09-21T00:43:47.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:47.656 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"btime":"2024-09-21T00:43:45:616061+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T00:43:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 5 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 msgr2=0x7fb3980b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 0x7fb3980b8a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006b9c0 tx=0x7fb3a0009500 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 msgr2=0x7fb3b019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400d770 tx=0x7fb3a400dc30 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 shutdown_connections 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb3980b6540 0x7fb3980b8a50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3b0108cf0 0x7fb3b019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3b01083a0 0x7fb3b019b750 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 --2- 172.21.15.16:0/2243346539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b0102a60 0x7fb3b019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.657+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 >> 172.21.15.16:0/2243346539 conn(0x7fb3b0079730 msgr2=0x7fb3b01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.658+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 shutdown_connections 2024-09-21T00:43:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:47.658+0000 7fb3b512d640 1 -- 172.21.15.16:0/2243346539 wait complete. 2024-09-21T00:43:47.770 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 podman[62664]: 2024-09-21 00:43:47.47030425 +0000 UTC m=+0.397415522 container start 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T00:43:47.770 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mds[62683]: -- 172.21.15.123:0/2065806255 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e96e2ad860 con 0x55e972455a80 2024-09-21T00:43:47.770 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: starting mds.e at 2024-09-21T00:43:47.770 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 bash[62664]: 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c 2024-09-21T00:43:47.770 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:43:47 smithi123 systemd[1]: Started Ceph mds.e for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:48.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:47 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2243346539' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:48.264 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:48.264 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.264 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.264 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:48.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:48.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:48.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:47 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2243346539' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:48.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:48.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:48.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:48.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:47 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2243346539' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:49.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:48 smithi016 ceph-mon[30947]: Deploying daemon mds.f on smithi178 2024-09-21T00:43:49.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:48 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:boot 2024-09-21T00:43:49.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:48 smithi016 ceph-mon[30947]: fsmap 5 up:standby 2024-09-21T00:43:49.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:48 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:43:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:48 smithi123 ceph-mon[34853]: Deploying daemon mds.f on smithi178 2024-09-21T00:43:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:48 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:boot 2024-09-21T00:43:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:48 smithi123 ceph-mon[34853]: fsmap 5 up:standby 2024-09-21T00:43:49.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:48 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:43:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:48 smithi178 ceph-mon[34888]: Deploying daemon mds.f on smithi178 2024-09-21T00:43:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:48 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:boot 2024-09-21T00:43:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:48 smithi178 ceph-mon[34888]: fsmap 5 up:standby 2024-09-21T00:43:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:48 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:43:49.748 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:49 smithi178 systemd[1]: Starting Ceph mds.f for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:50.026 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:49 smithi178 ceph-mon[34888]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:50.027 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:49 smithi178 podman[63672]: 2024-09-21 00:43:49.650312112 +0000 UTC m=+0.016059762 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:50.027 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:49 smithi178 podman[63672]: 2024-09-21 00:43:49.748178212 +0000 UTC m=+0.113925849 container create 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T00:43:50.027 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 podman[63672]: 2024-09-21 00:43:50.026368251 +0000 UTC m=+0.392115888 container init 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T00:43:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:49 smithi016 ceph-mon[30947]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:49 smithi123 ceph-mon[34853]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:50.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 podman[63672]: 2024-09-21 00:43:50.02928452 +0000 UTC m=+0.395032166 container start 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T00:43:50.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 ceph-mds[63691]: -- 172.21.15.178:0/3620463869 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d05a32dc20 con 0x55d05e4d5a80 2024-09-21T00:43:50.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: starting mds.f at 2024-09-21T00:43:50.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 bash[63672]: 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f 2024-09-21T00:43:50.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:43:50 smithi178 systemd[1]: Started Ceph mds.f for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:50.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:50.614 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 -- 172.21.15.16:0/2126501615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b0102870 msgr2=0x7f23b0102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 --2- 172.21.15.16:0/2126501615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b0102870 0x7f23b0102c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009900 tx=0x7f23a002a410 comp rx=0 tx=0).stop 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 -- 172.21.15.16:0/2126501615 shutdown_connections 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 --2- 172.21.15.16:0/2126501615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0108b00 0x7f23b010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 --2- 172.21.15.16:0/2126501615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b01081b0 0x7f23b01085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 --2- 172.21.15.16:0/2126501615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b0102870 0x7f23b0102c80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 -- 172.21.15.16:0/2126501615 >> 172.21.15.16:0/2126501615 conn(0x7f23b00fe2c0 msgr2=0x7f23b0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 -- 172.21.15.16:0/2126501615 shutdown_connections 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.088+0000 7f23b57a0640 1 -- 172.21.15.16:0/2126501615 wait complete. 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.089+0000 7f23b57a0640 1 Processor -- start 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.089+0000 7f23b57a0640 1 -- start start 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 0x7f23b019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b0108b00 0x7f23b019fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23b01127d0 con 0x7f23b01081b0 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23b0112650 con 0x7f23b0102870 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23b0112950 con 0x7f23b0108b00 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53360/0 (socket says 172.21.15.16:53360) 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 -- 172.21.15.16:0/3615326392 learned_addr learned my addr 172.21.15.16:0/3615326392 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b4f9f640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b0108b00 0x7f23b019fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23affff640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 0x7f23b019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 -- 172.21.15.16:0/3615326392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b0108b00 msgr2=0x7f23b019fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b0108b00 0x7f23b019fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 -- 172.21.15.16:0/3615326392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 msgr2=0x7f23b019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 0x7f23b019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 -- 172.21.15.16:0/3615326392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b01a0240 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23affff640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 0x7f23b019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23af7fe640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c970 tx=0x7f23a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004220 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23a40043c0 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.090+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b01a0530 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.091+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004a00 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.091+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b01a6c90 con 0x7f23b01081b0 2024-09-21T00:43:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.092+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b0102c80 con 0x7f23b01081b0 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.094+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f23a40079b0 con 0x7f23b01081b0 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.095+0000 7f23ad7fa640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 0x7f23980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.095+0000 7f23affff640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 0x7f23980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.095+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f23a40e6f50 con 0x7f23b01081b0 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.096+0000 7f23affff640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 0x7f23980b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23a0031440 tx=0x7f23a0009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.098+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23a4014030 con 0x7f23b01081b0 2024-09-21T00:43:51.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: Deploying daemon mds.c on smithi178 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6834/4194574330,v1:172.21.15.178:6835/4194574330] up:boot 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: fsmap 6 up:standby 2024-09-21T00:43:51.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:51 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:43:51.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.325+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23b019b400 con 0x7f23b01081b0 2024-09-21T00:43:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.326+0000 7f23ad7fa640 1 -- 172.21.15.16:0/3615326392 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7f23a40adc80 con 0x7f23b01081b0 2024-09-21T00:43:51.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:51.327 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"btime":"2024-09-21T00:43:50:959298+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T00:43:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-09-21T00:43:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 msgr2=0x7f23980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 0x7f23980b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23a0031440 tx=0x7f23a0009680 comp rx=0 tx=0).stop 2024-09-21T00:43:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 msgr2=0x7f23b019a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c970 tx=0x7f23a400ce30 comp rx=0 tx=0).stop 2024-09-21T00:43:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 shutdown_connections 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23980b6510 0x7f23980b8a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23b0108b00 0x7f23b019fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23b01081b0 0x7f23b019a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 --2- 172.21.15.16:0/3615326392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23b0102870 0x7f23b019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 >> 172.21.15.16:0/3615326392 conn(0x7f23b00fe2c0 msgr2=0x7f23b01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 shutdown_connections 2024-09-21T00:43:51.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:51.328+0000 7f23b57a0640 1 -- 172.21.15.16:0/3615326392 wait complete. 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:51.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:51.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: Deploying daemon mds.c on smithi178 2024-09-21T00:43:51.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:51.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6834/4194574330,v1:172.21.15.178:6835/4194574330] up:boot 2024-09-21T00:43:51.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: fsmap 6 up:standby 2024-09-21T00:43:51.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:51 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:51.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: Deploying daemon mds.c on smithi178 2024-09-21T00:43:51.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:51.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6834/4194574330,v1:172.21.15.178:6835/4194574330] up:boot 2024-09-21T00:43:51.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: fsmap 6 up:standby 2024-09-21T00:43:51.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:51 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:43:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:52 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3615326392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:52.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:52 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3615326392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:52.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:52 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3615326392' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:53.037 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:43:52 smithi178 systemd[1]: Started Ceph mds.c for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:53.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:54.247 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:54.247 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:54.247 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: Deploying daemon mds.h on smithi123 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:boot 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: fsmap 7 up:standby 2024-09-21T00:43:54.248 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:53 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: Deploying daemon mds.h on smithi123 2024-09-21T00:43:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:boot 2024-09-21T00:43:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: fsmap 7 up:standby 2024-09-21T00:43:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:53 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: Deploying daemon mds.h on smithi123 2024-09-21T00:43:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:boot 2024-09-21T00:43:54.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: fsmap 7 up:standby 2024-09-21T00:43:54.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:53 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 -- 172.21.15.16:0/1889903894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 msgr2=0x7f1c20102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 --2- 172.21.15.16:0/1889903894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c20102e70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009900 tx=0x7f1c1c02a410 comp rx=0 tx=0).stop 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 -- 172.21.15.16:0/1889903894 shutdown_connections 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 --2- 172.21.15.16:0/1889903894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 --2- 172.21.15.16:0/1889903894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 0x7f1c201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 --2- 172.21.15.16:0/1889903894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c20102e70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 -- 172.21.15.16:0/1889903894 >> 172.21.15.16:0/1889903894 conn(0x7f1c20079730 msgr2=0x7f1c20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:54.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 -- 172.21.15.16:0/1889903894 shutdown_connections 2024-09-21T00:43:54.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.867+0000 7f1c2867f640 1 -- 172.21.15.16:0/1889903894 wait complete. 2024-09-21T00:43:54.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 Processor -- start 2024-09-21T00:43:54.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 -- start start 2024-09-21T00:43:54.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:54.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 0x7f1c2019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20113a80 con 0x7f1c20102a60 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20113900 con 0x7f1c201083a0 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2867f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20113c00 con 0x7f1c20108cf0 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48958/0 (socket says 172.21.15.16:48958) 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 -- 172.21.15.16:0/2550061035 learned_addr learned my addr 172.21.15.16:0/2550061035 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c25c1a640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 0x7f1c2019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c26c1c640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 -- 172.21.15.16:0/2550061035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 msgr2=0x7f1c2019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 -- 172.21.15.16:0/2550061035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 msgr2=0x7f1c2019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.868+0000 7f1c2641b640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 0x7f1c2019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c2641b640 1 -- 172.21.15.16:0/2550061035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c201a0340 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c26c1c640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c2641b640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c005940 tx=0x7f1c1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c03f030 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c003aa0 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c035070 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c201a05d0 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.869+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c201a0ab0 con 0x7f1c20102a60 2024-09-21T00:43:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.870+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c20102e70 con 0x7f1c20102a60 2024-09-21T00:43:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.873+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1c1c042030 con 0x7f1c20102a60 2024-09-21T00:43:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.873+0000 7f1c177fe640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 0x7f1c0c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.874+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f1c1c107750 con 0x7f1c20102a60 2024-09-21T00:43:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.874+0000 7f1c25c1a640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 0x7f1c0c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:54.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.874+0000 7f1c25c1a640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 0x7f1c0c0b8a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c20100c50 tx=0x7f1c10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:54.877+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c1c0ce480 con 0x7f1c20102a60 2024-09-21T00:43:55.020 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:54 smithi123 systemd[1]: Starting Ceph mds.h for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:55.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.104+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c2019b5c0 con 0x7f1c20102a60 2024-09-21T00:43:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.105+0000 7f1c177fe640 1 -- 172.21.15.16:0/2550061035 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f1c1c0d2860 con 0x7f1c20102a60 2024-09-21T00:43:55.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:55.106 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"btime":"2024-09-21T00:43:53:204595+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T00:43:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-09-21T00:43:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 msgr2=0x7f1c0c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 0x7f1c0c0b8a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c20100c50 tx=0x7f1c10005f90 comp rx=0 tx=0).stop 2024-09-21T00:43:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 msgr2=0x7f1c2019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c005940 tx=0x7f1c1c004270 comp rx=0 tx=0).stop 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 shutdown_connections 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1c0c0b6540 0x7f1c0c0b8a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c20108cf0 0x7f1c2019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c201083a0 0x7f1c2019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 --2- 172.21.15.16:0/2550061035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c20102a60 0x7f1c2019a490 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 >> 172.21.15.16:0/2550061035 conn(0x7f1c20079730 msgr2=0x7f1c20101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 shutdown_connections 2024-09-21T00:43:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:55.107+0000 7f1c2867f640 1 -- 172.21.15.16:0/2550061035 wait complete. 2024-09-21T00:43:55.357 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 podman[62934]: 2024-09-21 00:43:54.970585546 +0000 UTC m=+0.015988858 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:55.357 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 podman[62934]: 2024-09-21 00:43:55.094005094 +0000 UTC m=+0.139408396 container create a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:43:55.770 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 podman[62934]: 2024-09-21 00:43:55.357213797 +0000 UTC m=+0.402617099 container init a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T00:43:55.770 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 podman[62934]: 2024-09-21 00:43:55.360187722 +0000 UTC m=+0.405591026 container start a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:43:55.770 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mds[62953]: -- 172.21.15.123:0/3553058206 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a774f3860 con 0x560a7b69b180 2024-09-21T00:43:55.770 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: starting mds.h at 2024-09-21T00:43:55.770 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 bash[62934]: a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 2024-09-21T00:43:55.771 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:43:55 smithi123 systemd[1]: Started Ceph mds.h for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:56.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:56.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2550061035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:56.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:56.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:56.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:55 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2550061035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:56.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:55 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2550061035' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:56.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:56.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:56.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:55 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:57.256 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:56 smithi178 ceph-mon[34888]: Deploying daemon mds.i on smithi178 2024-09-21T00:43:57.256 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:56 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:boot 2024-09-21T00:43:57.256 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:56 smithi178 ceph-mon[34888]: fsmap 8 up:standby 2024-09-21T00:43:57.256 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:56 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:43:57.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:56 smithi016 ceph-mon[30947]: Deploying daemon mds.i on smithi178 2024-09-21T00:43:57.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:56 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:boot 2024-09-21T00:43:57.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:56 smithi016 ceph-mon[30947]: fsmap 8 up:standby 2024-09-21T00:43:57.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:56 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:43:57.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:56 smithi123 ceph-mon[34853]: Deploying daemon mds.i on smithi178 2024-09-21T00:43:57.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:56 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:boot 2024-09-21T00:43:57.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:56 smithi123 ceph-mon[34853]: fsmap 8 up:standby 2024-09-21T00:43:57.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:56 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:43:57.537 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 systemd[1]: Starting Ceph mds.i for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:43:57.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:43:57.931 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:57 smithi178 ceph-mon[34888]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:57.931 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 podman[64210]: 2024-09-21 00:43:57.559671524 +0000 UTC m=+0.015847787 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:43:57.931 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 podman[64210]: 2024-09-21 00:43:57.694732046 +0000 UTC m=+0.150908298 container create 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T00:43:58.068 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:43:58.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:57 smithi016 ceph-mon[30947]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:58.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:57 smithi123 ceph-mon[34853]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 podman[64210]: 2024-09-21 00:43:57.931302503 +0000 UTC m=+0.387478756 container init 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 podman[64210]: 2024-09-21 00:43:57.934289756 +0000 UTC m=+0.390466010 container start 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 ceph-mds[64229]: -- 172.21.15.178:0/249624829 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599535ff860 con 0x5599577a7a80 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: starting mds.i at 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:58 smithi178 bash[64210]: 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 2024-09-21T00:43:58.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:43:58 smithi178 systemd[1]: Started Ceph mds.i for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 -- 172.21.15.16:0/319008372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc60109df0 msgr2=0x7efc60110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 --2- 172.21.15.16:0/319008372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc60109df0 0x7efc60110620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efc58009ca0 tx=0x7efc5802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 -- 172.21.15.16:0/319008372 shutdown_connections 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 --2- 172.21.15.16:0/319008372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc60109df0 0x7efc60110620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 --2- 172.21.15.16:0/319008372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc601094a0 0x7efc601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 --2- 172.21.15.16:0/319008372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 0x7efc60103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 -- 172.21.15.16:0/319008372 >> 172.21.15.16:0/319008372 conn(0x7efc6007b850 msgr2=0x7efc6007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 -- 172.21.15.16:0/319008372 shutdown_connections 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.616+0000 7efc664ea640 1 -- 172.21.15.16:0/319008372 wait complete. 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 Processor -- start 2024-09-21T00:43:58.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 -- start start 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 0x7efc6019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60109df0 0x7efc6019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efc60113ab0 con 0x7efc601094a0 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc60113930 con 0x7efc60103b60 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.617+0000 7efc664ea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efc60113c30 con 0x7efc60109df0 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48990/0 (socket says 172.21.15.16:48990) 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 -- 172.21.15.16:0/422543986 learned_addr learned my addr 172.21.15.16:0/422543986 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5ffff640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 0x7efc6019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc64a87640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60109df0 0x7efc6019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 -- 172.21.15.16:0/422543986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60109df0 msgr2=0x7efc6019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60109df0 0x7efc6019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 -- 172.21.15.16:0/422543986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 msgr2=0x7efc6019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 0x7efc6019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 -- 172.21.15.16:0/422543986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc601a0290 con 0x7efc601094a0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5f7fe640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c8c0 tx=0x7efc5400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54007bb0 con 0x7efc601094a0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc601a0580 con 0x7efc601094a0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc601a6da0 con 0x7efc601094a0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc54007d50 con 0x7efc601094a0 2024-09-21T00:43:58.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.618+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540186a0 con 0x7efc601094a0 2024-09-21T00:43:58.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.619+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc60103f70 con 0x7efc601094a0 2024-09-21T00:43:58.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.621+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7efc5400f450 con 0x7efc601094a0 2024-09-21T00:43:58.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.622+0000 7efc5d7fa640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 0x7efc480b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:43:58.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.622+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7efc540e7170 con 0x7efc601094a0 2024-09-21T00:43:58.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.622+0000 7efc5ffff640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 0x7efc480b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:43:58.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.622+0000 7efc5ffff640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 0x7efc480b8a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc5000abe0 tx=0x7efc5000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:43:58.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.625+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc54014030 con 0x7efc601094a0 2024-09-21T00:43:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.885+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc6010bc40 con 0x7efc601094a0 2024-09-21T00:43:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.885+0000 7efc5d7fa640 1 -- 172.21.15.16:0/422543986 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7efc540adf30 con 0x7efc601094a0 2024-09-21T00:43:58.887 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:43:58.887 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"btime":"2024-09-21T00:43:58:824201+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24644,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T00:43:58.887 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 10 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 msgr2=0x7efc480b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 0x7efc480b8a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efc5000abe0 tx=0x7efc5000a2d0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 msgr2=0x7efc6019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c8c0 tx=0x7efc5400ccc0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 shutdown_connections 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7efc480b6540 0x7efc480b8a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60109df0 0x7efc6019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc601094a0 0x7efc6019a980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 --2- 172.21.15.16:0/422543986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc60103b60 0x7efc6019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:43:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 >> 172.21.15.16:0/422543986 conn(0x7efc6007b850 msgr2=0x7efc60105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:43:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 shutdown_connections 2024-09-21T00:43:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:43:58.888+0000 7efc664ea640 1 -- 172.21.15.16:0/422543986 wait complete. 2024-09-21T00:43:59.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: Deploying daemon mds.g on smithi016 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:boot 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: fsmap 9 up:standby 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:43:59.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:43:59 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/422543986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: Deploying daemon mds.g on smithi016 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:boot 2024-09-21T00:43:59.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: fsmap 9 up:standby 2024-09-21T00:43:59.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:43:59.521 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:43:59 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/422543986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: Deploying daemon mds.g on smithi016 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:boot 2024-09-21T00:43:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: fsmap 9 up:standby 2024-09-21T00:43:59.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:43:59.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:43:59 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/422543986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:01.166 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:00 smithi016 systemd[1]: Starting Ceph mds.g for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:44:01.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:01 smithi016 ceph-mon[30947]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:01.420 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 podman[72015]: 2024-09-21 00:44:01.06838668 +0000 UTC m=+0.016600971 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:44:01.421 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 podman[72015]: 2024-09-21 00:44:01.173478553 +0000 UTC m=+0.121692829 container create 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T00:44:01.421 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 podman[72015]: 2024-09-21 00:44:01.42024852 +0000 UTC m=+0.368462802 container init 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T00:44:01.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:44:01.604 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:01 smithi178 ceph-mon[34888]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:01.759 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 podman[72015]: 2024-09-21 00:44:01.423393121 +0000 UTC m=+0.371607408 container start 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:44:01.759 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 ceph-mds[72035]: -- 172.21.15.16:0/2912892862 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637ce655860 con 0x5637d27fd600 2024-09-21T00:44:01.759 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: starting mds.g at 2024-09-21T00:44:01.760 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 bash[72015]: 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 2024-09-21T00:44:01.760 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:44:01 smithi016 systemd[1]: Started Ceph mds.g for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:44:01.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:01 smithi123 ceph-mon[34853]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:01.858 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 -- 172.21.15.16:0/3234194435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c104860 msgr2=0x7fac8c104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 --2- 172.21.15.16:0/3234194435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c104860 0x7fac8c104c70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fac88009900 tx=0x7fac8802a410 comp rx=0 tx=0).stop 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 -- 172.21.15.16:0/3234194435 shutdown_connections 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 --2- 172.21.15.16:0/3234194435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c10de10 0x7fac8c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 --2- 172.21.15.16:0/3234194435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c105290 0x7fac8c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 --2- 172.21.15.16:0/3234194435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c104860 0x7fac8c104c70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 -- 172.21.15.16:0/3234194435 >> 172.21.15.16:0/3234194435 conn(0x7fac8c079730 msgr2=0x7fac8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 -- 172.21.15.16:0/3234194435 shutdown_connections 2024-09-21T00:44:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.560+0000 7fac943cc640 1 -- 172.21.15.16:0/3234194435 wait complete. 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 Processor -- start 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 -- start start 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c104860 0x7fac8c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c10de10 0x7fac8c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c113a80 con 0x7fac8c105290 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c113900 con 0x7fac8c10de10 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac943cc640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c113c00 con 0x7fac8c104860 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac91967640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac91967640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49032/0 (socket says 172.21.15.16:49032) 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac91967640 1 -- 172.21.15.16:0/3410950941 learned_addr learned my addr 172.21.15.16:0/3410950941 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.561+0000 7fac92168640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c104860 0x7fac8c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac92969640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c10de10 0x7fac8c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 -- 172.21.15.16:0/3410950941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c104860 msgr2=0x7fac8c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c104860 0x7fac8c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 -- 172.21.15.16:0/3410950941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c10de10 msgr2=0x7fac8c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c10de10 0x7fac8c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 -- 172.21.15.16:0/3410950941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c1a8730 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac91967640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00d950 tx=0x7fac7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c017070 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac7c009c30 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c1a8a20 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0047a0 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.562+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1a8fb0 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.563+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c104c70 con 0x7fac8c105290 2024-09-21T00:44:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.565+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fac7c004020 con 0x7fac8c105290 2024-09-21T00:44:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.565+0000 7fac837fe640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 0x7fac780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.566+0000 7fac92168640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 0x7fac780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.566+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fac7c0e6b00 con 0x7fac8c105290 2024-09-21T00:44:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.566+0000 7fac92168640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 0x7fac780b8aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac88000c00 tx=0x7fac88031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.570+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac7c020020 con 0x7fac8c105290 2024-09-21T00:44:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.807+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac8c02e640 con 0x7fac8c105290 2024-09-21T00:44:02.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.808+0000 7fac837fe640 1 -- 172.21.15.16:0/3410950941 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fac7c0ad830 con 0x7fac8c105290 2024-09-21T00:44:02.809 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:02.809 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":11,"btime":"2024-09-21T00:44:02:303378+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24644,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T00:44:02.810 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 11 2024-09-21T00:44:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 msgr2=0x7fac780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 0x7fac780b8aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac88000c00 tx=0x7fac88031400 comp rx=0 tx=0).stop 2024-09-21T00:44:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 msgr2=0x7fac8c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00d950 tx=0x7fac7c00de10 comp rx=0 tx=0).stop 2024-09-21T00:44:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 shutdown_connections 2024-09-21T00:44:02.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fac780b6590 0x7fac780b8aa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8c10de10 0x7fac8c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c105290 0x7fac8c102cb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 --2- 172.21.15.16:0/3410950941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c104860 0x7fac8c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:02.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 >> 172.21.15.16:0/3410950941 conn(0x7fac8c079730 msgr2=0x7fac8c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:02.812 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:02.812 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:02.812 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:02.812 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: Deploying daemon mds.a on smithi016 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6838/3052513368,v1:172.21.15.16:6839/3052513368] up:boot 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: fsmap 10 up:standby 2024-09-21T00:44:02.813 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:02 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:44:02.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.810+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 shutdown_connections 2024-09-21T00:44:02.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:02.811+0000 7fac943cc640 1 -- 172.21.15.16:0/3410950941 wait complete. 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:03.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: Deploying daemon mds.a on smithi016 2024-09-21T00:44:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6838/3052513368,v1:172.21.15.16:6839/3052513368] up:boot 2024-09-21T00:44:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: fsmap 10 up:standby 2024-09-21T00:44:03.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:02 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:03.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:03.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: Deploying daemon mds.a on smithi016 2024-09-21T00:44:03.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6838/3052513368,v1:172.21.15.16:6839/3052513368] up:boot 2024-09-21T00:44:03.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: fsmap 10 up:standby 2024-09-21T00:44:03.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:02 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:44:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:03 smithi016 ceph-mon[30947]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:03.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:03 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3410950941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:04.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:03 smithi123 ceph-mon[34853]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:04.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:03 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3410950941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:04.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:03 smithi178 ceph-mon[34888]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:04.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:03 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3410950941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:04.159 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:03 smithi016 systemd[1]: Starting Ceph mds.a for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:44:04.410 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 podman[72398]: 2024-09-21 00:44:04.29336362 +0000 UTC m=+0.016565778 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:44:04.411 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 podman[72398]: 2024-09-21 00:44:04.410234658 +0000 UTC m=+0.133436846 container create edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T00:44:05.009 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 podman[72398]: 2024-09-21 00:44:04.663538897 +0000 UTC m=+0.386741040 container init edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T00:44:05.010 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 podman[72398]: 2024-09-21 00:44:04.666520171 +0000 UTC m=+0.389722316 container start edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T00:44:05.010 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 ceph-mds[72417]: -- 172.21.15.16:0/2761462334 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556944de1c20 con 0x556948f89600 2024-09-21T00:44:05.010 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: starting mds.a at 2024-09-21T00:44:05.010 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 bash[72398]: edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 2024-09-21T00:44:05.010 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:44:04 smithi016 systemd[1]: Started Ceph mds.a for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:44:06.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:44:06.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: Deploying daemon mds.b on smithi123 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6840/1186818130,v1:172.21.15.16:6841/1186818130] up:boot 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: fsmap 11 up:standby 2024-09-21T00:44:06.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:05 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: Deploying daemon mds.b on smithi123 2024-09-21T00:44:06.244 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6840/1186818130,v1:172.21.15.16:6841/1186818130] up:boot 2024-09-21T00:44:06.245 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: fsmap 11 up:standby 2024-09-21T00:44:06.245 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:05 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:44:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:06.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: Deploying daemon mds.b on smithi123 2024-09-21T00:44:06.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6840/1186818130,v1:172.21.15.16:6841/1186818130] up:boot 2024-09-21T00:44:06.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: fsmap 11 up:standby 2024-09-21T00:44:06.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:05 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:44:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:07.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 -- 172.21.15.16:0/2978069251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794102650 msgr2=0x7f7794102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 --2- 172.21.15.16:0/2978069251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794102650 0x7f7794102a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7790009900 tx=0x7f779002a480 comp rx=0 tx=0).stop 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 -- 172.21.15.16:0/2978069251 shutdown_connections 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 --2- 172.21.15.16:0/2978069251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794110200 0x7f7794112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 --2- 172.21.15.16:0/2978069251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 0x7f779410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 --2- 172.21.15.16:0/2978069251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794102650 0x7f7794102a60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 -- 172.21.15.16:0/2978069251 >> 172.21.15.16:0/2978069251 conn(0x7f7794079760 msgr2=0x7f7794079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 -- 172.21.15.16:0/2978069251 shutdown_connections 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.017+0000 7f779b6a2640 1 -- 172.21.15.16:0/2978069251 wait complete. 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 Processor -- start 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 -- start start 2024-09-21T00:44:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794102650 0x7f779419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 0x7f779419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7794115ca0 con 0x7f7794110200 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7794115b20 con 0x7f7794102650 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779b6a2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7794115e20 con 0x7f7794102fa0 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52674/0 (socket says 172.21.15.16:52674) 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 -- 172.21.15.16:0/3407834182 learned_addr learned my addr 172.21.15.16:0/3407834182 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f779943e640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794102650 0x7f779419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7798c3d640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 0x7f779419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 -- 172.21.15.16:0/3407834182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 msgr2=0x7f779419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:07.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 0x7f779419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 -- 172.21.15.16:0/3407834182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794102650 msgr2=0x7f779419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794102650 0x7f779419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.018+0000 7f7799c3f640 1 -- 172.21.15.16:0/3407834182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77941a25a0 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f7799c3f640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f778c00eb10 tx=0x7f778c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c004b20 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f778c004cc0 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941a2890 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c010670 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.019+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941a8ff0 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.020+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779406c1f0 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.022+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f778c005000 con 0x7f7794110200 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.022+0000 7f77867fc640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 0x7f77800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:07.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.023+0000 7f779943e640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 0x7f77800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:07.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.023+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f778c0e75e0 con 0x7f7794110200 2024-09-21T00:44:07.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.023+0000 7f779943e640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 0x7f77800b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7790031440 tx=0x7f7790009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:07.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.025+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f778c056710 con 0x7f7794110200 2024-09-21T00:44:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.253+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7794102a60 con 0x7f7794110200 2024-09-21T00:44:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.254+0000 7f77867fc640 1 -- 172.21.15.16:0/3407834182 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f7794102a60 con 0x7f7794110200 2024-09-21T00:44:07.255 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":12,"btime":"2024-09-21T00:44:05:594726+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24644,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T00:44:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 12 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 msgr2=0x7f77800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 0x7f77800b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7790031440 tx=0x7f7790009560 comp rx=0 tx=0).stop 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 msgr2=0x7f77941a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f778c00eb10 tx=0x7f778c00c2d0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 shutdown_connections 2024-09-21T00:44:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f77800b6590 0x7f77800b8aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7794110200 0x7f77941a1e70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7794102fa0 0x7f779419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 --2- 172.21.15.16:0/3407834182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7794102650 0x7f779419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 >> 172.21.15.16:0/3407834182 conn(0x7f7794079760 msgr2=0x7f7794108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 shutdown_connections 2024-09-21T00:44:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:07.256+0000 7f779b6a2640 1 -- 172.21.15.16:0/3407834182 wait complete. 2024-09-21T00:44:07.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 podman[63218]: 2024-09-21 00:44:07.151805159 +0000 UTC m=+0.117557464 container create 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:44:07.770 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 podman[63218]: 2024-09-21 00:44:07.412844041 +0000 UTC m=+0.378596365 container init 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T00:44:07.770 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 podman[63218]: 2024-09-21 00:44:07.415841476 +0000 UTC m=+0.381593786 container start 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:44:07.770 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mds[63237]: -- 172.21.15.123:0/3485342356 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9713a1860 con 0x55e975549180 2024-09-21T00:44:07.770 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: starting mds.b at 2024-09-21T00:44:07.770 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 bash[63218]: 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 2024-09-21T00:44:07.771 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:07 smithi123 systemd[1]: Started Ceph mds.b for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:44:08.219 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:08.219 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3407834182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:08.219 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.219 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.220 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.220 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.220 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.220 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:07 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3407834182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:07 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3407834182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:08.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:07 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:09.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:08 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:boot 2024-09-21T00:44:09.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:08 smithi016 ceph-mon[30947]: fsmap 12 up:standby 2024-09-21T00:44:09.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:08 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:44:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:08 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:boot 2024-09-21T00:44:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:08 smithi123 ceph-mon[34853]: fsmap 12 up:standby 2024-09-21T00:44:09.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:08 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:44:09.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:08 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:boot 2024-09-21T00:44:09.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:08 smithi178 ceph-mon[34888]: fsmap 12 up:standby 2024-09-21T00:44:09.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:08 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:44:09.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:10.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:10.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:09 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.023 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:09 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:10.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:10.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:10.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:09 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:44:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 -- 172.21.15.16:0/3759193018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82541094a0 msgr2=0x7f82541098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 --2- 172.21.15.16:0/3759193018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82541094a0 0x7f82541098b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8248009900 tx=0x7f824802a410 comp rx=0 tx=0).stop 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 -- 172.21.15.16:0/3759193018 shutdown_connections 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 --2- 172.21.15.16:0/3759193018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8254109df0 0x7f8254110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 --2- 172.21.15.16:0/3759193018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82541094a0 0x7f82541098b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 --2- 172.21.15.16:0/3759193018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254103b60 0x7f8254103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.809+0000 7f8258aae640 1 -- 172.21.15.16:0/3759193018 >> 172.21.15.16:0/3759193018 conn(0x7f825407b850 msgr2=0x7f825407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.810+0000 7f8258aae640 1 -- 172.21.15.16:0/3759193018 shutdown_connections 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.810+0000 7f8258aae640 1 -- 172.21.15.16:0/3759193018 wait complete. 2024-09-21T00:44:10.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.810+0000 7f8258aae640 1 Processor -- start 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.810+0000 7f8258aae640 1 -- start start 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 0x7f825419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254109df0 0x7f825419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113ab0 con 0x7f8254103b60 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113930 con 0x7f82541094a0 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8258aae640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113c30 con 0x7f8254109df0 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52690/0 (socket says 172.21.15.16:52690) 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 -- 172.21.15.16:0/6777726 learned_addr learned my addr 172.21.15.16:0/6777726 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8252d9d640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254109df0 0x7f825419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:10.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8251d9b640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 0x7f825419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 -- 172.21.15.16:0/6777726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254109df0 msgr2=0x7f825419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254109df0 0x7f825419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 -- 172.21.15.16:0/6777726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 msgr2=0x7f825419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 0x7f825419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 -- 172.21.15.16:0/6777726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82541a04f0 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f8251d9b640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 0x7f825419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f825259c640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824400e9f0 tx=0x7f824400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.811+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824400cd80 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.812+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82541a07e0 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.812+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82440054d0 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.812+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244010690 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.812+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82541a6f40 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.813+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8254104de0 con 0x7f8254103b60 2024-09-21T00:44:10.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.814+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8244004e30 con 0x7f8254103b60 2024-09-21T00:44:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.815+0000 7f82437fe640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 0x7f823c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.815+0000 7f8251d9b640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 0x7f823c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.816+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f82440e7550 con 0x7f8254103b60 2024-09-21T00:44:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.816+0000 7f8251d9b640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 0x7f823c0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8248009230 tx=0x7f8248000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:10.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:10.819+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8244056710 con 0x7f8254103b60 2024-09-21T00:44:11.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.075+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8254103f70 con 0x7f8254103b60 2024-09-21T00:44:11.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.076+0000 7f82437fe640 1 -- 172.21.15.16:0/6777726 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7f8254103f70 con 0x7f8254103b60 2024-09-21T00:44:11.077 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:11.077 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"btime":"2024-09-21T00:44:07:833532+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24620,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24644,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24677,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T00:44:11.078 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 msgr2=0x7f823c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 0x7f823c0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8248009230 tx=0x7f8248000bc0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 msgr2=0x7f825419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824400e9f0 tx=0x7f824400edf0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 shutdown_connections 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f823c0b6510 0x7f823c0b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254109df0 0x7f825419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82541094a0 0x7f825419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 --2- 172.21.15.16:0/6777726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8254103b60 0x7f825419a580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:11.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 >> 172.21.15.16:0/6777726 conn(0x7f825407b850 msgr2=0x7f8254105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:11.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 shutdown_connections 2024-09-21T00:44:11.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:11.079+0000 7f8258aae640 1 -- 172.21.15.16:0/6777726 wait complete. 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/6777726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:11.717 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:11.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T00:44:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/6777726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:12.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:12.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/6777726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:44:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:44:12.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 -- 172.21.15.16:0/3348052309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 msgr2=0x7f70881098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 --2- 172.21.15.16:0/3348052309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f70881098b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f707c009900 tx=0x7f707c02a410 comp rx=0 tx=0).stop 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 -- 172.21.15.16:0/3348052309 shutdown_connections 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 --2- 172.21.15.16:0/3348052309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 0x7f7088110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 --2- 172.21.15.16:0/3348052309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f70881098b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 --2- 172.21.15.16:0/3348052309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f7088103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 -- 172.21.15.16:0/3348052309 >> 172.21.15.16:0/3348052309 conn(0x7f708807b850 msgr2=0x7f708807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 -- 172.21.15.16:0/3348052309 shutdown_connections 2024-09-21T00:44:12.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 -- 172.21.15.16:0/3348052309 wait complete. 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.504+0000 7f708f6a7640 1 Processor -- start 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 -- start start 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f708819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 0x7f708819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113ad0 con 0x7f70881094a0 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113950 con 0x7f7088103b60 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708f6a7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113c50 con 0x7f7088109df0 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52698/0 (socket says 172.21.15.16:52698) 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 -- 172.21.15.16:0/812892769 learned_addr learned my addr 172.21.15.16:0/812892769 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:12.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708dc44640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 0x7f708819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 -- 172.21.15.16:0/812892769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 msgr2=0x7f708819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708d443640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f708819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 0x7f708819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 -- 172.21.15.16:0/812892769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 msgr2=0x7f708819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f708819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 -- 172.21.15.16:0/812892769 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881a03f0 con 0x7f70881094a0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708d443640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f708819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.505+0000 7f708cc42640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f707c02a930 tx=0x7f707c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.506+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c03f030 con 0x7f70881094a0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.506+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f707c003cb0 con 0x7f70881094a0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.506+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881a0680 con 0x7f70881094a0 2024-09-21T00:44:12.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.506+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c035070 con 0x7f70881094a0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.506+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881a6f00 con 0x7f70881094a0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.507+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088104de0 con 0x7f70881094a0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.508+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f707c042030 con 0x7f70881094a0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.509+0000 7f70867fc640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 0x7f70700b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.509+0000 7f708d443640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 0x7f70700b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.509+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f707c107910 con 0x7f70881094a0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.510+0000 7f708d443640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 0x7f70700b8a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7078007eb0 tx=0x7f70780073c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:12.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.512+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f707c0ce640 con 0x7f70881094a0 2024-09-21T00:44:12.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.701+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f708810bbc0 con 0x7f70881094a0 2024-09-21T00:44:12.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.701+0000 7f70867fc640 1 -- 172.21.15.16:0/812892769 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f707c0d2a20 con 0x7f70881094a0 2024-09-21T00:44:12.702 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:44:12.703 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-09-21T00:44:12.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 msgr2=0x7f70700b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:12.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 0x7f70700b8a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7078007eb0 tx=0x7f70780073c0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 msgr2=0x7f708819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f707c02a930 tx=0x7f707c004270 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 shutdown_connections 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6540 0x7f70700b8a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088109df0 0x7f708819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881094a0 0x7f708819aae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.703+0000 7f708f6a7640 1 --2- 172.21.15.16:0/812892769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088103b60 0x7f708819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.704+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 >> 172.21.15.16:0/812892769 conn(0x7f708807b850 msgr2=0x7f70881075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.704+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 shutdown_connections 2024-09-21T00:44:12.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:12.704+0000 7f708f6a7640 1 -- 172.21.15.16:0/812892769 wait complete. 2024-09-21T00:44:13.412 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T00:44:13.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T00:44:13.680 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:13.938 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:13 smithi016 ceph-mon[30947]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:13.938 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/812892769' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:44:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:13 smithi123 ceph-mon[34853]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:13 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/812892769' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:44:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:13 smithi178 ceph-mon[34888]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:13 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/812892769' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:44:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 -- 172.21.15.16:0/1344724509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c1083a0 msgr2=0x7f765c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 --2- 172.21.15.16:0/1344724509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c1083a0 0x7f765c1087b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7644009900 tx=0x7f764402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 -- 172.21.15.16:0/1344724509 shutdown_connections 2024-09-21T00:44:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 --2- 172.21.15.16:0/1344724509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c108cf0 0x7f765c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 --2- 172.21.15.16:0/1344724509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c1083a0 0x7f765c1087b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 --2- 172.21.15.16:0/1344724509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c102a60 0x7f765c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 -- 172.21.15.16:0/1344724509 >> 172.21.15.16:0/1344724509 conn(0x7f765c079730 msgr2=0x7f765c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 -- 172.21.15.16:0/1344724509 shutdown_connections 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.159+0000 7f76617a2640 1 -- 172.21.15.16:0/1344724509 wait complete. 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.160+0000 7f76617a2640 1 Processor -- start 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.160+0000 7f76617a2640 1 -- start start 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 0x7f765c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c1083a0 0x7f765c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f765c112960 con 0x7f765c108cf0 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1127e0 con 0x7f765c102a60 2024-09-21T00:44:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f765c112ae0 con 0x7f765c1083a0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51492/0 (socket says 172.21.15.16:51492) 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 -- 172.21.15.16:0/3430101770 learned_addr learned my addr 172.21.15.16:0/3430101770 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765a7fc640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c1083a0 0x7f765c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765affd640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 0x7f765c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 -- 172.21.15.16:0/3430101770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c1083a0 msgr2=0x7f765c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c1083a0 0x7f765c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 -- 172.21.15.16:0/3430101770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 msgr2=0x7f765c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 0x7f765c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 -- 172.21.15.16:0/3430101770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c19f2e0 con 0x7f765c108cf0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765affd640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 0x7f765c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f765b7fe640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f765400eaa0 tx=0x7f765400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765400cdb0 con 0x7f765c108cf0 2024-09-21T00:44:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7654005020 con 0x7f765c108cf0 2024-09-21T00:44:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c19f5d0 con 0x7f765c108cf0 2024-09-21T00:44:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.161+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540116d0 con 0x7f765c108cf0 2024-09-21T00:44:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.162+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c1a5d30 con 0x7f765c108cf0 2024-09-21T00:44:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.162+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c102e70 con 0x7f765c108cf0 2024-09-21T00:44:14.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.165+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f76540051d0 con 0x7f765c108cf0 2024-09-21T00:44:14.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.166+0000 7f7653fff640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 0x7f76480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:14.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.166+0000 7f765affd640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 0x7f76480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:14.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.166+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f76540e73e0 con 0x7f765c108cf0 2024-09-21T00:44:14.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.167+0000 7f765affd640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 0x7f76480b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f764c005d00 tx=0x7f764c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:14.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.169+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7654016030 con 0x7f765c108cf0 2024-09-21T00:44:14.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.359+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f765c19a4a0 con 0x7f765c108cf0 2024-09-21T00:44:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.640+0000 7f7653fff640 1 -- 172.21.15.16:0/3430101770 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f76540ae070 con 0x7f765c108cf0 2024-09-21T00:44:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 msgr2=0x7f76480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 0x7f76480b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f764c005d00 tx=0x7f764c005c70 comp rx=0 tx=0).stop 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 msgr2=0x7f765c19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f765400eaa0 tx=0x7f765400ef60 comp rx=0 tx=0).stop 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 shutdown_connections 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f76480b6510 0x7f76480b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f765c108cf0 0x7f765c19ebb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f765c1083a0 0x7f765c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 --2- 172.21.15.16:0/3430101770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f765c102a60 0x7f765c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 >> 172.21.15.16:0/3430101770 conn(0x7f765c079730 msgr2=0x7f765c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 shutdown_connections 2024-09-21T00:44:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:14.643+0000 7f76617a2640 1 -- 172.21.15.16:0/3430101770 wait complete. 2024-09-21T00:44:14.960 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:14 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:44:15.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:14 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:44:15.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:14 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:44:15.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T00:44:15.541 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:15.940 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:15 smithi016 ceph-mon[30947]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:15.941 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:15 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:44:15.941 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:15 smithi016 ceph-mon[30947]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:44:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:15 smithi123 ceph-mon[34853]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:15 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:44:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:15 smithi123 ceph-mon[34853]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:44:16.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:15 smithi178 ceph-mon[34888]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:16.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:15 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3430101770' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:44:16.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:15 smithi178 ceph-mon[34888]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3792153685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac108d20 msgr2=0x7fc9ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3792153685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac108d20 0x7fc9ac10f550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ca0 tx=0x7fc9a402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3792153685 shutdown_connections 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3792153685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac108d20 0x7fc9ac10f550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3792153685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac1083d0 0x7fc9ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3792153685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3792153685 >> 172.21.15.16:0/3792153685 conn(0x7fc9ac079760 msgr2=0x7fc9ac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:16.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3792153685 shutdown_connections 2024-09-21T00:44:16.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.038+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3792153685 wait complete. 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 Processor -- start 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 -- start start 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac1083d0 0x7fc9ac19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac108d20 0x7fc9ac19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac112990 con 0x7fc9ac102ae0 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac112810 con 0x7fc9ac1083d0 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.039+0000 7fc9b10fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac112b10 con 0x7fc9ac108d20 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51514/0 (socket says 172.21.15.16:51514) 2024-09-21T00:44:16.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 -- 172.21.15.16:0/3652207357 learned_addr learned my addr 172.21.15.16:0/3652207357 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9ab59e640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac108d20 0x7fc9ac19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aa59c640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac1083d0 0x7fc9ac19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 -- 172.21.15.16:0/3652207357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac108d20 msgr2=0x7fc9ac19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac108d20 0x7fc9ac19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 -- 172.21.15.16:0/3652207357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac1083d0 msgr2=0x7fc9ac19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac1083d0 0x7fc9ac19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 -- 172.21.15.16:0/3652207357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac1a03e0 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc9aad9d640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d950 tx=0x7fc99c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.040+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c017070 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.041+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1a06d0 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.041+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c009c30 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.041+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00f620 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.041+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1a6e30 con 0x7fc9ac102ae0 2024-09-21T00:44:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.042+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac103d10 con 0x7fc9ac102ae0 2024-09-21T00:44:16.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.044+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc99c005030 con 0x7fc9ac102ae0 2024-09-21T00:44:16.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.045+0000 7fc993fff640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 0x7fc9940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:16.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.045+0000 7fc9aa59c640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 0x7fc9940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:16.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.045+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7fc99c0e6b90 con 0x7fc9ac102ae0 2024-09-21T00:44:16.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.046+0000 7fc9aa59c640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 0x7fc9940b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac102620 tx=0x7fc9a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:16.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.049+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc99c009de0 con 0x7fc9ac102ae0 2024-09-21T00:44:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.238+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc9ac02e640 con 0x7fc9ac102ae0 2024-09-21T00:44:16.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.652+0000 7fc993fff640 1 -- 172.21.15.16:0/3652207357 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7fc99c0b1a90 con 0x7fc9ac102ae0 2024-09-21T00:44:16.653 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-09-21T00:44:16.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 msgr2=0x7fc9940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:16.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 0x7fc9940b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac102620 tx=0x7fc9a0005f90 comp rx=0 tx=0).stop 2024-09-21T00:44:16.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 msgr2=0x7fc9ac19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:16.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d950 tx=0x7fc99c00de10 comp rx=0 tx=0).stop 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 shutdown_connections 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9940b6510 0x7fc9940b8a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9ac108d20 0x7fc9ac19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9ac1083d0 0x7fc9ac19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 --2- 172.21.15.16:0/3652207357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac102ae0 0x7fc9ac19a470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.655+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 >> 172.21.15.16:0/3652207357 conn(0x7fc9ac079760 msgr2=0x7fc9ac06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.656+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 shutdown_connections 2024-09-21T00:44:16.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:16.656+0000 7fc9b10fd640 1 -- 172.21.15.16:0/3652207357 wait complete. 2024-09-21T00:44:16.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:16 smithi016 ceph-mon[30947]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:44:16.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:16 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:44:17.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:16 smithi123 ceph-mon[34853]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:44:17.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:16 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:44:17.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:16 smithi178 ceph-mon[34888]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:44:17.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:16 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:44:17.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T00:44:17.600 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:17.667 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:17 smithi016 ceph-mon[30947]: pgmap v285: 33 pgs: 1 creating+activating, 6 creating+peering, 14 unknown, 12 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:17.667 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:44:17.667 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:17 smithi016 ceph-mon[30947]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:44:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:17 smithi123 ceph-mon[34853]: pgmap v285: 33 pgs: 1 creating+activating, 6 creating+peering, 14 unknown, 12 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:17 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:44:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:17 smithi123 ceph-mon[34853]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:44:18.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:17 smithi178 ceph-mon[34888]: pgmap v285: 33 pgs: 1 creating+activating, 6 creating+peering, 14 unknown, 12 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:18.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:17 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3652207357' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:44:18.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:17 smithi178 ceph-mon[34888]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- 172.21.15.16:0/1976752552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b04106c00 msgr2=0x7f7b04110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/1976752552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b04106c00 0x7f7b04110670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009ca0 tx=0x7f7afc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- 172.21.15.16:0/1976752552 shutdown_connections 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/1976752552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b04106c00 0x7f7b04110670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/1976752552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041062b0 0x7f7b041066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/1976752552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b041020c0 0x7f7b041024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- 172.21.15.16:0/1976752552 >> 172.21.15.16:0/1976752552 conn(0x7f7b04079e40 msgr2=0x7f7b0407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:18.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- 172.21.15.16:0/1976752552 shutdown_connections 2024-09-21T00:44:18.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- 172.21.15.16:0/1976752552 wait complete. 2024-09-21T00:44:18.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 Processor -- start 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.144+0000 7f7b0a78a640 1 -- start start 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041020c0 0x7f7b0419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b04106c00 0x7f7b0419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04113b00 con 0x7f7b041062b0 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04113980 con 0x7f7b04106c00 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b0a78a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04113c80 con 0x7f7b041020c0 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51534/0 (socket says 172.21.15.16:51534) 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 -- 172.21.15.16:0/397256177 learned_addr learned my addr 172.21.15.16:0/397256177 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:18.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b03fff640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041020c0 0x7f7b0419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b08d27640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b04106c00 0x7f7b0419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 -- 172.21.15.16:0/397256177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041020c0 msgr2=0x7f7b0419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041020c0 0x7f7b0419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 -- 172.21.15.16:0/397256177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b04106c00 msgr2=0x7f7b0419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b04106c00 0x7f7b0419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.145+0000 7f7b037fe640 1 -- 172.21.15.16:0/397256177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b041a0340 con 0x7f7b041062b0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.146+0000 7f7b037fe640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c8c0 tx=0x7f7af800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.146+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8007bb0 con 0x7f7b041062b0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.146+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7af8007d50 con 0x7f7b041062b0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.146+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af80187c0 con 0x7f7b041062b0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.147+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b041a0630 con 0x7f7b041062b0 2024-09-21T00:44:18.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.147+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b041a0b20 con 0x7f7b041062b0 2024-09-21T00:44:18.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.148+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b041024d0 con 0x7f7b041062b0 2024-09-21T00:44:18.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.150+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f7af800fa20 con 0x7f7b041062b0 2024-09-21T00:44:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.151+0000 7f7b017fa640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 0x7f7aec0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.151+0000 7f7b03fff640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 0x7f7aec0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.151+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7f7af80e7400 con 0x7f7b041062b0 2024-09-21T00:44:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.152+0000 7f7b03fff640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 0x7f7aec0b8ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005d00 tx=0x7f7af400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.154+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b041a0b20 con 0x7f7b041062b0 2024-09-21T00:44:18.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.387+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7b0419b5c0 con 0x7f7b041062b0 2024-09-21T00:44:18.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.675+0000 7f7b017fa640 1 -- 172.21.15.16:0/397256177 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7b0419b5c0 con 0x7f7b041062b0 2024-09-21T00:44:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T00:44:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 msgr2=0x7f7aec0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 0x7f7aec0b8ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005d00 tx=0x7f7af400b410 comp rx=0 tx=0).stop 2024-09-21T00:44:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 msgr2=0x7f7b0419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c8c0 tx=0x7f7af800cd80 comp rx=0 tx=0).stop 2024-09-21T00:44:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 shutdown_connections 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7aec0b65c0 0x7f7aec0b8ad0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b04106c00 0x7f7b0419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b041062b0 0x7f7b0419aa30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 --2- 172.21.15.16:0/397256177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b041020c0 0x7f7b0419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 >> 172.21.15.16:0/397256177 conn(0x7f7b04079e40 msgr2=0x7f7b041074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 shutdown_connections 2024-09-21T00:44:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:18.678+0000 7f7b0a78a640 1 -- 172.21.15.16:0/397256177 wait complete. 2024-09-21T00:44:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:18 smithi016 ceph-mon[30947]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:44:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:18 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:44:19.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:18 smithi016 ceph-mon[30947]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:44:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:18 smithi123 ceph-mon[34853]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:44:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:18 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:44:19.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:18 smithi123 ceph-mon[34853]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:44:19.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:18 smithi178 ceph-mon[34888]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:44:19.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:18 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:44:19.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:18 smithi178 ceph-mon[34888]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:44:19.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:44:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:19 smithi016 ceph-mon[30947]: pgmap v288: 97 pgs: 1 creating+activating, 8 creating+peering, 53 unknown, 35 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:19 smithi016 ceph-mon[30947]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:44:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:19 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:44:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:19 smithi016 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:44:20.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:19 smithi016 ceph-mon[30947]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:44:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:19 smithi123 ceph-mon[34853]: pgmap v288: 97 pgs: 1 creating+activating, 8 creating+peering, 53 unknown, 35 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:19 smithi123 ceph-mon[34853]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:44:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:19 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:44:20.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:19 smithi123 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:44:20.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:19 smithi123 ceph-mon[34853]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:44:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:19 smithi178 ceph-mon[34888]: pgmap v288: 97 pgs: 1 creating+activating, 8 creating+peering, 53 unknown, 35 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:44:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:19 smithi178 ceph-mon[34888]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:44:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:19 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/397256177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:44:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:19 smithi178 ceph-mon[34888]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:44:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:19 smithi178 ceph-mon[34888]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.101+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/927756093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58103b90 msgr2=0x7f1e58103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.101+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/927756093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58103b90 0x7f1e58103fa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009900 tx=0x7f1e4802a410 comp rx=0 tx=0).stop 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/927756093 shutdown_connections 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/927756093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58109e20 0x7f1e58110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/927756093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e581094d0 0x7f1e581098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/927756093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58103b90 0x7f1e58103fa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/927756093 >> 172.21.15.16:0/927756093 conn(0x7f1e580ff5e0 msgr2=0x7f1e58101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/927756093 shutdown_connections 2024-09-21T00:44:20.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/927756093 wait complete. 2024-09-21T00:44:20.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 Processor -- start 2024-09-21T00:44:20.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.102+0000 7f1e5eeb6640 1 -- start start 2024-09-21T00:44:20.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58103b90 0x7f1e5819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:20.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:20.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 0x7f1e5819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58113ae0 con 0x7f1e581094d0 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58113960 con 0x7f1e58103b90 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5eeb6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58113c60 con 0x7f1e58109e20 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51560/0 (socket says 172.21.15.16:51560) 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 -- 172.21.15.16:0/1700041688 learned_addr learned my addr 172.21.15.16:0/1700041688 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5d453640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 0x7f1e5819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5cc52640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58103b90 0x7f1e5819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 -- 172.21.15.16:0/1700041688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 msgr2=0x7f1e5819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 0x7f1e5819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 -- 172.21.15.16:0/1700041688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58103b90 msgr2=0x7f1e5819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:20.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58103b90 0x7f1e5819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 -- 172.21.15.16:0/1700041688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e581a0420 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e5d453640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 0x7f1e5819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e57fff640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00d740 tx=0x7f1e4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.103+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c017070 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.104+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4c00de50 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.104+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e581a0710 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.104+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00f620 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.104+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e581a6e70 con 0x7f1e581094d0 2024-09-21T00:44:20.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.105+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e58103fa0 con 0x7f1e581094d0 2024-09-21T00:44:20.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.106+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1e4c01a070 con 0x7f1e581094d0 2024-09-21T00:44:20.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.107+0000 7f1e55ffb640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 0x7f1e400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:20.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.107+0000 7f1e5cc52640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 0x7f1e400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:20.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.107+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f1e4c0e6ba0 con 0x7f1e581094d0 2024-09-21T00:44:20.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.108+0000 7f1e5cc52640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 0x7f1e400b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e48031440 tx=0x7f1e48005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:20.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.110+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e4c0ad600 con 0x7f1e581094d0 2024-09-21T00:44:20.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.304+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e5819b5e0 con 0x7f1e581094d0 2024-09-21T00:44:20.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.305+0000 7f1e55ffb640 1 -- 172.21.15.16:0/1700041688 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22293 (secure 0 0 0) 0x7f1e5819b5e0 con 0x7f1e581094d0 2024-09-21T00:44:20.306 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:20.306 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":73,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:18.388858+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:44:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 msgr2=0x7f1e400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 0x7f1e400b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e48031440 tx=0x7f1e48005d50 comp rx=0 tx=0).stop 2024-09-21T00:44:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 msgr2=0x7f1e5819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00d740 tx=0x7f1e4c00dc00 comp rx=0 tx=0).stop 2024-09-21T00:44:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 shutdown_connections 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1e400b6590 0x7f1e400b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e58109e20 0x7f1e5819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e581094d0 0x7f1e5819aa50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 --2- 172.21.15.16:0/1700041688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e58103b90 0x7f1e5819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 >> 172.21.15.16:0/1700041688 conn(0x7f1e580ff5e0 msgr2=0x7f1e58101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 shutdown_connections 2024-09-21T00:44:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:20.308+0000 7f1e5eeb6640 1 -- 172.21.15.16:0/1700041688 wait complete. 2024-09-21T00:44:21.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:20 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:active 2024-09-21T00:44:21.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:20 smithi016 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:20 smithi016 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:20 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1700041688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:20 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:active 2024-09-21T00:44:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:20 smithi123 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:20 smithi123 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:20 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1700041688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:21.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:20 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] up:active 2024-09-21T00:44:21.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:20 smithi178 ceph-mon[34888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:20 smithi178 ceph-mon[34888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:21.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:20 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1700041688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:21.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:44:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:21.838 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:21 smithi016 ceph-mon[30947]: pgmap v290: 97 pgs: 1 creating+activating, 5 creating+peering, 28 unknown, 63 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T00:44:21.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 -- 172.21.15.16:0/3701247264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c102a60 msgr2=0x7f982c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:21.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 --2- 172.21.15.16:0/3701247264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c102a60 0x7f982c102e70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9828009ca0 tx=0x7f982802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 -- 172.21.15.16:0/3701247264 shutdown_connections 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 --2- 172.21.15.16:0/3701247264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c108cf0 0x7f982c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 --2- 172.21.15.16:0/3701247264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 --2- 172.21.15.16:0/3701247264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c102a60 0x7f982c102e70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 -- 172.21.15.16:0/3701247264 >> 172.21.15.16:0/3701247264 conn(0x7f982c079730 msgr2=0x7f982c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 -- 172.21.15.16:0/3701247264 shutdown_connections 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.928+0000 7f98338b2640 1 -- 172.21.15.16:0/3701247264 wait complete. 2024-09-21T00:44:21.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 Processor -- start 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 -- start start 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c102a60 0x7f982c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f982c113a80 con 0x7f982c108cf0 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f982c113900 con 0x7f982c102a60 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f98338b2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f982c113c00 con 0x7f982c1083a0 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.929+0000 7f9831e4f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51570/0 (socket says 172.21.15.16:51570) 2024-09-21T00:44:21.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 -- 172.21.15.16:0/748441113 learned_addr learned my addr 172.21.15.16:0/748441113 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f983164e640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c102a60 0x7f982c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9830e4d640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 -- 172.21.15.16:0/748441113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 msgr2=0x7f982c1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 -- 172.21.15.16:0/748441113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c102a60 msgr2=0x7f982c10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c102a60 0x7f982c10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 -- 172.21.15.16:0/748441113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c1a8710 con 0x7f982c108cf0 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9830e4d640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f9831e4f640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f982400d750 tx=0x7f982400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824017070 con 0x7f982c108cf0 2024-09-21T00:44:21.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98240054d0 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1a8a00 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824004c60 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.930+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1a8ef0 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.931+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c102e70 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.933+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f9824009bd0 con 0x7f982c108cf0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.934+0000 7f981e7fc640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 0x7f98180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.934+0000 7f983164e640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 0x7f98180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:21.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.934+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f98240e6f70 con 0x7f982c108cf0 2024-09-21T00:44:21.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.935+0000 7f983164e640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 0x7f98180b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9828005e30 tx=0x7f9828009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:21.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:21.937+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98240ad930 con 0x7f982c108cf0 2024-09-21T00:44:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:21 smithi123 ceph-mon[34853]: pgmap v290: 97 pgs: 1 creating+activating, 5 creating+peering, 28 unknown, 63 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T00:44:22.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:21 smithi178 ceph-mon[34888]: pgmap v290: 97 pgs: 1 creating+activating, 5 creating+peering, 28 unknown, 63 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T00:44:22.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.125+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982c02e640 con 0x7f982c108cf0 2024-09-21T00:44:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.127+0000 7f981e7fc640 1 -- 172.21.15.16:0/748441113 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22293 (secure 0 0 0) 0x7f98240b1d10 con 0x7f982c108cf0 2024-09-21T00:44:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:22.130 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":73,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:18.388858+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:44:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 msgr2=0x7f98180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 0x7f98180b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9828005e30 tx=0x7f9828009360 comp rx=0 tx=0).stop 2024-09-21T00:44:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 msgr2=0x7f982c110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f982400d750 tx=0x7f982400dc10 comp rx=0 tx=0).stop 2024-09-21T00:44:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 shutdown_connections 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f98180b6510 0x7f98180b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f982c108cf0 0x7f982c110a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f982c1083a0 0x7f982c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 --2- 172.21.15.16:0/748441113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c102a60 0x7f982c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 >> 172.21.15.16:0/748441113 conn(0x7f982c079730 msgr2=0x7f982c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.129+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 shutdown_connections 2024-09-21T00:44:22.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:22.130+0000 7f98338b2640 1 -- 172.21.15.16:0/748441113 wait complete. 2024-09-21T00:44:22.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T00:44:23.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/748441113' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:23.022 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:22 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/748441113' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:23.022 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:22 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:44:22.842+0000 7faca6177640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:44:23.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:22 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/748441113' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:23.074 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 -- 172.21.15.16:0/3328852948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 msgr2=0x7f70881087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 --2- 172.21.15.16:0/3328852948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f70881087b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f707c009900 tx=0x7f707c02a410 comp rx=0 tx=0).stop 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 -- 172.21.15.16:0/3328852948 shutdown_connections 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 --2- 172.21.15.16:0/3328852948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 0x7f708810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 --2- 172.21.15.16:0/3328852948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f70881087b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 --2- 172.21.15.16:0/3328852948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f7088102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 -- 172.21.15.16:0/3328852948 >> 172.21.15.16:0/3328852948 conn(0x7f7088079730 msgr2=0x7f7088079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 -- 172.21.15.16:0/3328852948 shutdown_connections 2024-09-21T00:44:23.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.549+0000 7f708c8f6640 1 -- 172.21.15.16:0/3328852948 wait complete. 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 Processor -- start 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 -- start start 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f708819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 0x7f708819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7088112960 con 0x7f70881083a0 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70881127e0 con 0x7f7088102a60 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708c8f6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7088112ae0 con 0x7f7088108cf0 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f7085d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f7085d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51576/0 (socket says 172.21.15.16:51576) 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f7085d9b640 1 -- 172.21.15.16:0/624928275 learned_addr learned my addr 172.21.15.16:0/624928275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:23.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.550+0000 7f708659c640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f708819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7086d9d640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 0x7f708819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 -- 172.21.15.16:0/624928275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 msgr2=0x7f708819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 0x7f708819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 -- 172.21.15.16:0/624928275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 msgr2=0x7f708819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f708819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 -- 172.21.15.16:0/624928275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881a0470 con 0x7f70881083a0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f708659c640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f708819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f7085d9b640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f707c032fd0 tx=0x7f707c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c03f030 con 0x7f70881083a0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f707c004490 con 0x7f70881083a0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881a0700 con 0x7f70881083a0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c035070 con 0x7f70881083a0 2024-09-21T00:44:23.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.551+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881a6ec0 con 0x7f70881083a0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.552+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088103ce0 con 0x7f70881083a0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.555+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f707c042030 con 0x7f70881083a0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.555+0000 7f70777fe640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.556+0000 7f708659c640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.556+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f707c107b50 con 0x7f70881083a0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.556+0000 7f708659c640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 0x7f70700b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7078005fd0 tx=0x7f707800b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:23.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.559+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f707c0ce530 con 0x7f70881083a0 2024-09-21T00:44:23.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:23 smithi016 ceph-mon[30947]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T00:44:23.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:23.787+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7088102e70 con 0x7f70881083a0 2024-09-21T00:44:24.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:23 smithi123 ceph-mon[34853]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T00:44:24.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:23 smithi178 ceph-mon[34888]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T00:44:24.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.708+0000 7f70777fe640 1 -- 172.21.15.16:0/624928275 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f7088102e70 con 0x7f70881083a0 2024-09-21T00:44:24.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 msgr2=0x7f70700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:24.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 0x7f70700b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7078005fd0 tx=0x7f707800b5f0 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 msgr2=0x7f708819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f707c032fd0 tx=0x7f707c004270 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 shutdown_connections 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f70700b6510 0x7f70700b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7088108cf0 0x7f708819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70881083a0 0x7f708819aaa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 --2- 172.21.15.16:0/624928275 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088102a60 0x7f708819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.711+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 >> 172.21.15.16:0/624928275 conn(0x7f7088079730 msgr2=0x7f708806c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.712+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 shutdown_connections 2024-09-21T00:44:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:24.712+0000 7f708c8f6640 1 -- 172.21.15.16:0/624928275 wait complete. 2024-09-21T00:44:25.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:24 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:44:25.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:24 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:44:25.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:24 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:44:25.498 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T00:44:25.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T00:44:25.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:25 smithi016 ceph-mon[30947]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:44:25.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:25 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:44:25.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:25 smithi016 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:25.766 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:25 smithi123 ceph-mon[34853]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:44:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:25 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:44:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:25 smithi123 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:25 smithi178 ceph-mon[34888]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:44:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:25 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/624928275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:44:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:25 smithi178 ceph-mon[34888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 -- 172.21.15.16:0/2993083024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 msgr2=0x7f58841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 --2- 172.21.15.16:0/2993083024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f58841087b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5878009900 tx=0x7f587802a410 comp rx=0 tx=0).stop 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 -- 172.21.15.16:0/2993083024 shutdown_connections 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 --2- 172.21.15.16:0/2993083024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884108cf0 0x7f588410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 --2- 172.21.15.16:0/2993083024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f58841087b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 --2- 172.21.15.16:0/2993083024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884102a60 0x7f5884102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 -- 172.21.15.16:0/2993083024 >> 172.21.15.16:0/2993083024 conn(0x7f5884079730 msgr2=0x7f5884079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 -- 172.21.15.16:0/2993083024 shutdown_connections 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.280+0000 7f588c771640 1 -- 172.21.15.16:0/2993083024 wait complete. 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 Processor -- start 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 -- start start 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 0x7f588419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884108cf0 0x7f588419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5884112960 con 0x7f58841083a0 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58841127e0 con 0x7f5884102a60 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588c771640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5884112ae0 con 0x7f5884108cf0 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f5889d0c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f5889d0c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52314/0 (socket says 172.21.15.16:52314) 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f5889d0c640 1 -- 172.21.15.16:0/3471019092 learned_addr learned my addr 172.21.15.16:0/3471019092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.281+0000 7f588a50d640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 0x7f588419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f588ad0e640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884108cf0 0x7f588419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 -- 172.21.15.16:0/3471019092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884108cf0 msgr2=0x7f588419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884108cf0 0x7f588419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 -- 172.21.15.16:0/3471019092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 msgr2=0x7f588419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 0x7f588419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 -- 172.21.15.16:0/3471019092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58841a03d0 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f588a50d640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 0x7f588419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f5889d0c640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5878006010 tx=0x7f5878004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587803f030 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5878003aa0 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f588c771640 1 -- 172.21.15.16:0/3471019092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58841a0660 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878035070 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.282+0000 7f588c771640 1 -- 172.21.15.16:0/3471019092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58841a6e20 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.283+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c005290 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.285+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5878042030 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.286+0000 7f58777fe640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 0x7f58700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.286+0000 7f588a50d640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 0x7f58700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.286+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f5878107a80 con 0x7f58841083a0 2024-09-21T00:44:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.286+0000 7f588a50d640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 0x7f58700b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5880009c20 tx=0x7f5880005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.289+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58780ce460 con 0x7f58841083a0 2024-09-21T00:44:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.533+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f586c005850 con 0x7f58841083a0 2024-09-21T00:44:26.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.716+0000 7f58777fe640 1 -- 172.21.15.16:0/3471019092 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f58780d2840 con 0x7f58841083a0 2024-09-21T00:44:26.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.718+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 msgr2=0x7f58700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.718+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 0x7f58700b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5880009c20 tx=0x7f5880005f90 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.718+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 msgr2=0x7f588419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.718+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5878006010 tx=0x7f5878004060 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 shutdown_connections 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f58700b6510 0x7f58700b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5884108cf0 0x7f588419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58841083a0 0x7f588419aa00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 --2- 172.21.15.16:0/3471019092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5884102a60 0x7f588419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 >> 172.21.15.16:0/3471019092 conn(0x7f5884079730 msgr2=0x7f588406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 shutdown_connections 2024-09-21T00:44:26.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:26.719+0000 7f58757fa640 1 -- 172.21.15.16:0/3471019092 wait complete. 2024-09-21T00:44:26.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:26 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:44:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:26 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:44:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:26 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T00:44:27.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T00:44:27.674 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:28.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T00:44:28.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:27 smithi016 ceph-mon[30947]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:44:27.842+0000 7faca6177640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:44:28.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:28.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T00:44:28.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:27 smithi123 ceph-mon[34853]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3471019092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T00:44:28.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:27 smithi178 ceph-mon[34888]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 -- 172.21.15.16:0/819119771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc954102270 msgr2=0x7fc954102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 --2- 172.21.15.16:0/819119771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc954102270 0x7fc954102680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc944009900 tx=0x7fc94402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 -- 172.21.15.16:0/819119771 shutdown_connections 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 --2- 172.21.15.16:0/819119771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9541084b0 0x7fc95410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 --2- 172.21.15.16:0/819119771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 0x7fc954107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 --2- 172.21.15.16:0/819119771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc954102270 0x7fc954102680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 -- 172.21.15.16:0/819119771 >> 172.21.15.16:0/819119771 conn(0x7fc954077cc0 msgr2=0x7fc954078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:28.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 -- 172.21.15.16:0/819119771 shutdown_connections 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.165+0000 7fc959ed0640 1 -- 172.21.15.16:0/819119771 wait complete. 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.166+0000 7fc959ed0640 1 Processor -- start 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.166+0000 7fc959ed0640 1 -- start start 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.166+0000 7fc959ed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc954102270 0x7fc9541982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.166+0000 7fc959ed0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 0x7fc954198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541118f0 con 0x7fc9541084b0 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc954111770 con 0x7fc954102270 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc954111a70 con 0x7fc954107b60 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52318/0 (socket says 172.21.15.16:52318) 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 -- 172.21.15.16:0/1103484743 learned_addr learned my addr 172.21.15.16:0/1103484743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:28.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc9537fe640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc954102270 0x7fc9541982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc952ffd640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 0x7fc954198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 -- 172.21.15.16:0/1103484743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 msgr2=0x7fc954198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 0x7fc954198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 -- 172.21.15.16:0/1103484743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc954102270 msgr2=0x7fc9541982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc954102270 0x7fc9541982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 -- 172.21.15.16:0/1103484743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95419e250 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc953fff640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00de10 tx=0x7fc94c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c003b70 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc94c003d10 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95419e540 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00ea40 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.167+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9541a6eb0 con 0x7fc9541084b0 2024-09-21T00:44:28.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.168+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9541034a0 con 0x7fc9541084b0 2024-09-21T00:44:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.170+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc94c00ebe0 con 0x7fc9541084b0 2024-09-21T00:44:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.171+0000 7fc950ff9640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.171+0000 7fc9537fe640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:28.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.171+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fc94c0e75f0 con 0x7fc9541084b0 2024-09-21T00:44:28.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.171+0000 7fc9537fe640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 0x7fc93c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc944031440 tx=0x7fc944009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:28.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.174+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc94c0adfd0 con 0x7fc9541084b0 2024-09-21T00:44:28.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.404+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc954102680 con 0x7fc9541084b0 2024-09-21T00:44:28.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.729+0000 7fc950ff9640 1 -- 172.21.15.16:0/1103484743 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fc954102680 con 0x7fc9541084b0 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 msgr2=0x7fc93c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 0x7fc93c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc944031440 tx=0x7fc944009560 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 msgr2=0x7fc95419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00de10 tx=0x7fc94c00b730 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 shutdown_connections 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9541084b0 0x7fc95419db20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc954107b60 0x7fc954198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 --2- 172.21.15.16:0/1103484743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc954102270 0x7fc9541982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 >> 172.21.15.16:0/1103484743 conn(0x7fc954077cc0 msgr2=0x7fc954105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 shutdown_connections 2024-09-21T00:44:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:28.732+0000 7fc959ed0640 1 -- 172.21.15.16:0/1103484743 wait complete. 2024-09-21T00:44:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:active 2024-09-21T00:44:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:44:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T00:44:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T00:44:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T00:44:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:28 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:active 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T00:44:29.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:28 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] up:active 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T00:44:29.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:28 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:44:29.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T00:44:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-21T00:44:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:44:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:active 2024-09-21T00:44:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:44:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T00:44:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-21T00:44:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:29 smithi016 ceph-mon[30947]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:active 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T00:44:30.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-21T00:44:30.021 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:29 smithi123 ceph-mon[34853]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-21T00:44:30.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: pgmap v294: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1103484743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] up:active 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-21T00:44:30.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:29 smithi178 ceph-mon[34888]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-21T00:44:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.189+0000 7f0fc7425640 1 -- 172.21.15.16:0/3380607543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 msgr2=0x7f0fc0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.189+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3380607543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc0075bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009900 tx=0x7f0fbc02a410 comp rx=0 tx=0).stop 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 -- 172.21.15.16:0/3380607543 shutdown_connections 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3380607543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0110110 0x7f0fc0112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3380607543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0076100 0x7f0fc010fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3380607543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc0075bc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 -- 172.21.15.16:0/3380607543 >> 172.21.15.16:0/3380607543 conn(0x7f0fc00ff600 msgr2=0x7f0fc0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 -- 172.21.15.16:0/3380607543 shutdown_connections 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 -- 172.21.15.16:0/3380607543 wait complete. 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 Processor -- start 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.190+0000 7f0fc7425640 1 -- start start 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0076100 0x7f0fc019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 0x7f0fc01a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc0115cc0 con 0x7f0fc00757b0 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc0115b40 con 0x7f0fc0076100 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc7425640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc0115e40 con 0x7f0fc0110110 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52348/0 (socket says 172.21.15.16:52348) 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 -- 172.21.15.16:0/3026652318 learned_addr learned my addr 172.21.15.16:0/3026652318 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc59c2640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 0x7f0fc01a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc49c0640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0076100 0x7f0fc019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 -- 172.21.15.16:0/3026652318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 msgr2=0x7f0fc01a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 0x7f0fc01a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 -- 172.21.15.16:0/3026652318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0076100 msgr2=0x7f0fc019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0076100 0x7f0fc019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 -- 172.21.15.16:0/3026652318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc01a2520 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc59c2640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 0x7f0fc01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.191+0000 7f0fc51c1640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc006010 tx=0x7f0fbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.192+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc03f030 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.192+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fbc003800 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.192+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc01a27b0 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.192+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc035070 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.192+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc01a2ce0 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.193+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc0075bc0 con 0x7f0fc00757b0 2024-09-21T00:44:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.194+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0fbc003cb0 con 0x7f0fc00757b0 2024-09-21T00:44:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.195+0000 7f0fb67fc640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 0x7f0fac0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.195+0000 7f0fc49c0640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 0x7f0fac0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.195+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f0fbc107df0 con 0x7f0fc00757b0 2024-09-21T00:44:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.196+0000 7f0fc49c0640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 0x7f0fac0b8ad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0112500 tx=0x7f0fb0005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.198+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fc01a2ce0 con 0x7f0fc00757b0 2024-09-21T00:44:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.425+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0fc019d7a0 con 0x7f0fc00757b0 2024-09-21T00:44:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.747+0000 7f0fb67fc640 1 -- 172.21.15.16:0/3026652318 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f0fbc0ce7d0 con 0x7f0fc00757b0 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 msgr2=0x7f0fac0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 0x7f0fac0b8ad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0112500 tx=0x7f0fb0005c80 comp rx=0 tx=0).stop 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 msgr2=0x7f0fc019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc006010 tx=0x7f0fbc0042f0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 shutdown_connections 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0fac0b65c0 0x7f0fac0b8ad0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc0110110 0x7f0fc01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fc0076100 0x7f0fc019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 --2- 172.21.15.16:0/3026652318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc00757b0 0x7f0fc019c670 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:30.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 >> 172.21.15.16:0/3026652318 conn(0x7f0fc00ff600 msgr2=0x7f0fc01021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:30.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 shutdown_connections 2024-09-21T00:44:30.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:30.750+0000 7f0fc7425640 1 -- 172.21.15.16:0/3026652318 wait complete. 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:active 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: Cluster is now healthy 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T00:44:31.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:30 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:active 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: Cluster is now healthy 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T00:44:31.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:30 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] up:active 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: Cluster is now healthy 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-21T00:44:31.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:30 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:44:31.513 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T00:44:31.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T00:44:31.782 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:32.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:31 smithi016 ceph-mon[30947]: pgmap v295: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-09-21T00:44:32.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:31 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:44:32.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:31 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:active 2024-09-21T00:44:32.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:31 smithi016 ceph-mon[30947]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T00:44:32.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:31 smithi016 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:44:32.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:31 smithi123 ceph-mon[34853]: pgmap v295: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-09-21T00:44:32.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:31 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:44:32.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:31 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:active 2024-09-21T00:44:32.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:31 smithi123 ceph-mon[34853]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T00:44:32.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:31 smithi123 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:44:32.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:31 smithi178 ceph-mon[34888]: pgmap v295: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-09-21T00:44:32.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:31 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3026652318' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:44:32.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:31 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] up:active 2024-09-21T00:44:32.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:31 smithi178 ceph-mon[34888]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T00:44:32.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:31 smithi178 ceph-mon[34888]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 -- 172.21.15.16:0/37146616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 msgr2=0x7f72c0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 --2- 172.21.15.16:0/37146616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c0110620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009ca0 tx=0x7f72b802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 -- 172.21.15.16:0/37146616 shutdown_connections 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 --2- 172.21.15.16:0/37146616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c0110620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 --2- 172.21.15.16:0/37146616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c01094a0 0x7f72c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 --2- 172.21.15.16:0/37146616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c0103b60 0x7f72c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 -- 172.21.15.16:0/37146616 >> 172.21.15.16:0/37146616 conn(0x7f72c007b850 msgr2=0x7f72c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 -- 172.21.15.16:0/37146616 shutdown_connections 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 -- 172.21.15.16:0/37146616 wait complete. 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.257+0000 7f72c523a640 1 Processor -- start 2024-09-21T00:44:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 -- start start 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c0103b60 0x7f72c019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c01094a0 0x7f72c019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0113ab0 con 0x7f72c0109df0 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0113930 con 0x7f72c01094a0 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72c523a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0113c30 con 0x7f72c0103b60 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72bf59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72bf59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52370/0 (socket says 172.21.15.16:52370) 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72bf59e640 1 -- 172.21.15.16:0/4237218389 learned_addr learned my addr 172.21.15.16:0/4237218389 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72be59c640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c01094a0 0x7f72c019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.258+0000 7f72bed9d640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c0103b60 0x7f72c019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 -- 172.21.15.16:0/4237218389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c0103b60 msgr2=0x7f72c019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c0103b60 0x7f72c019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 -- 172.21.15.16:0/4237218389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c01094a0 msgr2=0x7f72c019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c01094a0 0x7f72c019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 -- 172.21.15.16:0/4237218389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c01a03d0 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72bf59e640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72b80098d0 tx=0x7f72b80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8003b70 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b8003d10 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01a0660 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b802fa20 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.259+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a6e20 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.260+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c0103f70 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.263+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f72b802fc20 con 0x7f72c0109df0 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.263+0000 7f72a7fff640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 0x7f72a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.264+0000 7f72bed9d640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 0x7f72a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.264+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f72b8108590 con 0x7f72c0109df0 2024-09-21T00:44:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.264+0000 7f72bed9d640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 0x7f72a80b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72b000bbe0 tx=0x7f72b000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.267+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72b80cef70 con 0x7f72c0109df0 2024-09-21T00:44:32.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.482+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f72c0063800 con 0x7f72a80b6510 2024-09-21T00:44:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.512+0000 7f72a7fff640 1 -- 172.21.15.16:0/4237218389 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f72c0063800 con 0x7f72a80b6510 2024-09-21T00:44:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.513+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 msgr2=0x7f72a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.513+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 0x7f72a80b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72b000bbe0 tx=0x7f72b000b390 comp rx=0 tx=0).stop 2024-09-21T00:44:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.513+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 msgr2=0x7f72c019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.513+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72b80098d0 tx=0x7f72b80317b0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 shutdown_connections 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f72a80b6510 0x7f72a80b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c0109df0 0x7f72c019fca0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c01094a0 0x7f72c019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 --2- 172.21.15.16:0/4237218389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c0103b60 0x7f72c019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 >> 172.21.15.16:0/4237218389 conn(0x7f72c007b850 msgr2=0x7f72c01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 shutdown_connections 2024-09-21T00:44:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:32.514+0000 7f72c523a640 1 -- 172.21.15.16:0/4237218389 wait complete. 2024-09-21T00:44:32.517 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:44:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:44:32.487+0000 7f6555160640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:44:32.517 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:44:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:44:32.487+0000 7f6555160640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:44:32.517 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:44:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:44:32.487+0000 7f6555160640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:44:32.517 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:44:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:44:32.487+0000 7f6555160640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:44:32.517 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:44:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x[31175]: 2024-09-21T00:44:32.487+0000 7f6555160640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:44:33.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:44:32.843+0000 7faca6177640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-21T00:44:33.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:44:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:44:32.843+0000 7faca6177640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T00:44:33.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T00:44:33.576 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:33.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:33 smithi016 ceph-mon[30947]: pgmap v296: 97 pgs: 97 active+clean; 583 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2024-09-21T00:44:33.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:33 smithi016 ceph-mon[30947]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:34.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:33 smithi123 ceph-mon[34853]: pgmap v296: 97 pgs: 97 active+clean; 583 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2024-09-21T00:44:34.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:33 smithi123 ceph-mon[34853]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:34.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:33 smithi178 ceph-mon[34888]: pgmap v296: 97 pgs: 97 active+clean; 583 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2024-09-21T00:44:34.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:33 smithi178 ceph-mon[34888]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 -- 172.21.15.16:0/2250498257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 msgr2=0x7f02001098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 --2- 172.21.15.16:0/2250498257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f02001098d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802a3f0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 -- 172.21.15.16:0/2250498257 shutdown_connections 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 --2- 172.21.15.16:0/2250498257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200109e10 0x7f0200110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 --2- 172.21.15.16:0/2250498257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f02001098d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 --2- 172.21.15.16:0/2250498257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200103b80 0x7f0200103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 -- 172.21.15.16:0/2250498257 >> 172.21.15.16:0/2250498257 conn(0x7f020007b8d0 msgr2=0x7f020007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 -- 172.21.15.16:0/2250498257 shutdown_connections 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.071+0000 7f020625f640 1 -- 172.21.15.16:0/2250498257 wait complete. 2024-09-21T00:44:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 Processor -- start 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 -- start start 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200103b80 0x7f020019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200109e10 0x7f020019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0200113ad0 con 0x7f02001094c0 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0200113950 con 0x7f0200109e10 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.072+0000 7f020625f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0200113c50 con 0x7f0200103b80 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52388/0 (socket says 172.21.15.16:52388) 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 -- 172.21.15.16:0/99243292 learned_addr learned my addr 172.21.15.16:0/99243292 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01ff7fe640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200103b80 0x7f020019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01fffff640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200109e10 0x7f020019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 -- 172.21.15.16:0/99243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200103b80 msgr2=0x7f020019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200103b80 0x7f020019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 -- 172.21.15.16:0/99243292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200109e10 msgr2=0x7f020019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200109e10 0x7f020019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 -- 172.21.15.16:0/99243292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001a0370 con 0x7f02001094c0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01f7fff640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a910 tx=0x7f01e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e803f030 con 0x7f02001094c0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e8003aa0 con 0x7f02001094c0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8035070 con 0x7f02001094c0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02001a0600 con 0x7f02001094c0 2024-09-21T00:44:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.073+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001a0a90 con 0x7f02001094c0 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.074+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0200103f90 con 0x7f02001094c0 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.076+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f01e8042030 con 0x7f02001094c0 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.077+0000 7f01fd7fa640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 0x7f01ec0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.077+0000 7f01ff7fe640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 0x7f01ec0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.077+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f01e81079c0 con 0x7f02001094c0 2024-09-21T00:44:34.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.077+0000 7f01ff7fe640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 0x7f01ec0b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01f000abe0 tx=0x7f01f000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:34.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.080+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01e80ce3a0 con 0x7f02001094c0 2024-09-21T00:44:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.294+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0200063800 con 0x7f01ec0b6540 2024-09-21T00:44:34.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.325+0000 7f01fd7fa640 1 -- 172.21.15.16:0/99243292 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0200063800 con 0x7f01ec0b6540 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 msgr2=0x7f01ec0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 0x7f01ec0b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f01f000abe0 tx=0x7f01f000a2d0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 msgr2=0x7f020019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a910 tx=0x7f01e8004270 comp rx=0 tx=0).stop 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 shutdown_connections 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f01ec0b6540 0x7f01ec0b8a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0200109e10 0x7f020019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02001094c0 0x7f020019aa60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 --2- 172.21.15.16:0/99243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0200103b80 0x7f020019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 >> 172.21.15.16:0/99243292 conn(0x7f020007b8d0 msgr2=0x7f0200107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 shutdown_connections 2024-09-21T00:44:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:34.327+0000 7f020625f640 1 -- 172.21.15.16:0/99243292 wait complete. 2024-09-21T00:44:34.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T00:44:35.252 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 -- 172.21.15.16:0/1488445223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb410de30 msgr2=0x7f5bb4110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/1488445223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb410de30 0x7f5bb4110320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009900 tx=0x7f5ba402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 -- 172.21.15.16:0/1488445223 shutdown_connections 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/1488445223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb410de30 0x7f5bb4110320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/1488445223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb4105320 0x7f5bb410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/1488445223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb41049d0 0x7f5bb4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 -- 172.21.15.16:0/1488445223 >> 172.21.15.16:0/1488445223 conn(0x7f5bb4079740 msgr2=0x7f5bb4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 -- 172.21.15.16:0/1488445223 shutdown_connections 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.749+0000 7f5bb8b99640 1 -- 172.21.15.16:0/1488445223 wait complete. 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 Processor -- start 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 -- start start 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb41049d0 0x7f5bb419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 0x7f5bb419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4113af0 con 0x7f5bb4105320 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4113970 con 0x7f5bb41049d0 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb8b99640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4113c70 con 0x7f5bb410de30 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59966/0 (socket says 172.21.15.16:59966) 2024-09-21T00:44:35.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 -- 172.21.15.16:0/4210127195 learned_addr learned my addr 172.21.15.16:0/4210127195 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb259c640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb41049d0 0x7f5bb419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb2d9d640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 0x7f5bb419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 -- 172.21.15.16:0/4210127195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 msgr2=0x7f5bb419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 0x7f5bb419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 -- 172.21.15.16:0/4210127195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb41049d0 msgr2=0x7f5bb419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb41049d0 0x7f5bb419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb1d9b640 1 -- 172.21.15.16:0/4210127195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb41a04b0 con 0x7f5bb4105320 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.750+0000 7f5bb2d9d640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 0x7f5bb419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bb1d9b640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c011830 con 0x7f5bb4105320 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41a07a0 con 0x7f5bb4105320 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b9c016070 con 0x7f5bb4105320 2024-09-21T00:44:35.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c010e00 con 0x7f5bb4105320 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.751+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a6f00 con 0x7f5bb4105320 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.752+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb406c240 con 0x7f5bb4105320 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.754+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5b9c0119d0 con 0x7f5bb4105320 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.754+0000 7f5bab7fe640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 0x7f5ba00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.754+0000 7f5bb259c640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 0x7f5ba00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.754+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f5b9c0e6ec0 con 0x7f5bb4105320 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.755+0000 7f5bb259c640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 0x7f5ba00b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406c940 tx=0x7f5bac009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.757+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b9c0ad7a0 con 0x7f5bb4105320 2024-09-21T00:44:35.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.976+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f5bb4100c90 con 0x7f5ba00b65a0 2024-09-21T00:44:35.978 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:35 smithi016 ceph-mon[30947]: pgmap v297: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-21T00:44:35.978 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:35 smithi016 ceph-mon[30947]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:35.978 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:35 smithi016 ceph-mon[30947]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:44:35.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.983+0000 7f5bab7fe640 1 -- 172.21.15.16:0/4210127195 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5bb4100c90 con 0x7f5ba00b65a0 2024-09-21T00:44:35.983 INFO:teuthology.orchestra.run.smithi016.stdout:/volumes/qa/sv_0/39f8efa0-3c0e-4f95-a291-5d3a3db8f7ac 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 msgr2=0x7f5ba00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 0x7f5ba00b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406c940 tx=0x7f5bac009670 comp rx=0 tx=0).stop 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 msgr2=0x7f5bb419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c00b8e0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 shutdown_connections 2024-09-21T00:44:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ba00b65a0 0x7f5ba00b8ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bb410de30 0x7f5bb419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bb4105320 0x7f5bb419aae0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 --2- 172.21.15.16:0/4210127195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bb41049d0 0x7f5bb419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 >> 172.21.15.16:0/4210127195 conn(0x7f5bb4079740 msgr2=0x7f5bb40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 shutdown_connections 2024-09-21T00:44:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:35.985+0000 7f5bb8b99640 1 -- 172.21.15.16:0/4210127195 wait complete. 2024-09-21T00:44:36.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:35 smithi123 ceph-mon[34853]: pgmap v297: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-21T00:44:36.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:35 smithi123 ceph-mon[34853]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:36.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:35 smithi123 ceph-mon[34853]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:44:36.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:35 smithi178 ceph-mon[34888]: pgmap v297: 97 pgs: 97 active+clean; 584 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-21T00:44:36.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:35 smithi178 ceph-mon[34888]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:36.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:35 smithi178 ceph-mon[34888]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:44:36.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T00:44:36.979 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:36 smithi016 ceph-mon[30947]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:37.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:36 smithi123 ceph-mon[34853]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:37.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:36 smithi178 ceph-mon[34888]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:37.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2867297123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b81083d0 msgr2=0x7ff6b81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:37.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2867297123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b81083d0 0x7ff6b81087e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009900 tx=0x7ff6a002a410 comp rx=0 tx=0).stop 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2867297123 shutdown_connections 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2867297123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b8108d20 0x7ff6b810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2867297123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b81083d0 0x7ff6b81087e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2867297123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 0x7ff6b8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2867297123 >> 172.21.15.16:0/2867297123 conn(0x7ff6b8079760 msgr2=0x7ff6b8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2867297123 shutdown_connections 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.482+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2867297123 wait complete. 2024-09-21T00:44:37.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 Processor -- start 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 -- start start 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 0x7ff6b819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b81083d0 0x7ff6b819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8113ab0 con 0x7ff6b8108d20 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8113930 con 0x7ff6b8102ae0 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6bca9d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8113c30 con 0x7ff6b81083d0 2024-09-21T00:44:37.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59984/0 (socket says 172.21.15.16:59984) 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 -- 172.21.15.16:0/2403521649 learned_addr learned my addr 172.21.15.16:0/2403521649 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6affff640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b81083d0 0x7ff6b819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b659c640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 0x7ff6b819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 -- 172.21.15.16:0/2403521649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b81083d0 msgr2=0x7ff6b819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b81083d0 0x7ff6b819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 -- 172.21.15.16:0/2403521649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 msgr2=0x7ff6b819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 0x7ff6b819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.483+0000 7ff6b6d9d640 1 -- 172.21.15.16:0/2403521649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b81a03f0 con 0x7ff6b8108d20 2024-09-21T00:44:37.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6b6d9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000eaa0 tx=0x7ff6b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000cdb0 con 0x7ff6b8108d20 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6b0005020 con 0x7ff6b8108d20 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b81a06e0 con 0x7ff6b8108d20 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00116d0 con 0x7ff6b8108d20 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.484+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b81a6e40 con 0x7ff6b8108d20 2024-09-21T00:44:37.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.485+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b8103d10 con 0x7ff6b8108d20 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.486+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ff6b00051d0 con 0x7ff6b8108d20 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.487+0000 7ff6af7fe640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 0x7ff6a40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.487+0000 7ff6b659c640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 0x7ff6a40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.487+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7ff6b00e79c0 con 0x7ff6b8108d20 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.488+0000 7ff6b659c640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 0x7ff6a40b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005d00 tx=0x7ff6a8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:37.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.490+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6b0016030 con 0x7ff6b8108d20 2024-09-21T00:44:37.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.707+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff6b8063800 con 0x7ff6a40b65a0 2024-09-21T00:44:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.736+0000 7ff6af7fe640 1 -- 172.21.15.16:0/2403521649 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff6b8063800 con 0x7ff6a40b65a0 2024-09-21T00:44:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 msgr2=0x7ff6a40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 0x7ff6a40b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005d00 tx=0x7ff6a8005c50 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 msgr2=0x7ff6b819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000eaa0 tx=0x7ff6b000ef60 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 shutdown_connections 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6a40b65a0 0x7ff6a40b8ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6b8108d20 0x7ff6b819fcc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b81083d0 0x7ff6b819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 --2- 172.21.15.16:0/2403521649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b8102ae0 0x7ff6b819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 >> 172.21.15.16:0/2403521649 conn(0x7ff6b8079760 msgr2=0x7ff6b81052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.738+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 shutdown_connections 2024-09-21T00:44:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:37.739+0000 7ff6bca9d640 1 -- 172.21.15.16:0/2403521649 wait complete. 2024-09-21T00:44:38.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:37 smithi016 ceph-mon[30947]: pgmap v298: 97 pgs: 97 active+clean; 586 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-09-21T00:44:38.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:37 smithi123 ceph-mon[34853]: pgmap v298: 97 pgs: 97 active+clean; 586 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-09-21T00:44:38.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:37 smithi178 ceph-mon[34888]: pgmap v298: 97 pgs: 97 active+clean; 586 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-09-21T00:44:38.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T00:44:38.847 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:38.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:38 smithi016 ceph-mon[30947]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:39.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:38 smithi178 ceph-mon[34888]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:39.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:38 smithi123 ceph-mon[34853]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 -- 172.21.15.16:0/1522797837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84103b60 msgr2=0x7fcf84103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 --2- 172.21.15.16:0/1522797837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84103b60 0x7fcf84103f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009900 tx=0x7fcf7402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 -- 172.21.15.16:0/1522797837 shutdown_connections 2024-09-21T00:44:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 --2- 172.21.15.16:0/1522797837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf84109df0 0x7fcf84110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 --2- 172.21.15.16:0/1522797837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf841094a0 0x7fcf841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 --2- 172.21.15.16:0/1522797837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84103b60 0x7fcf84103f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 -- 172.21.15.16:0/1522797837 >> 172.21.15.16:0/1522797837 conn(0x7fcf8407b850 msgr2=0x7fcf8407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:39.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 -- 172.21.15.16:0/1522797837 shutdown_connections 2024-09-21T00:44:39.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 -- 172.21.15.16:0/1522797837 wait complete. 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.328+0000 7fcf89386640 1 Processor -- start 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 -- start start 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf84103b60 0x7fcf8419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf841094a0 0x7fcf8419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84113b10 con 0x7fcf84109df0 2024-09-21T00:44:39.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84113990 con 0x7fcf841094a0 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf89386640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84113c90 con 0x7fcf84103b60 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60006/0 (socket says 172.21.15.16:60006) 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf837fe640 1 -- 172.21.15.16:0/1520915498 learned_addr learned my addr 172.21.15.16:0/1520915498 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf827fc640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf841094a0 0x7fcf8419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.329+0000 7fcf82ffd640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf84103b60 0x7fcf8419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 -- 172.21.15.16:0/1520915498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf84103b60 msgr2=0x7fcf8419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:39.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf84103b60 0x7fcf8419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 -- 172.21.15.16:0/1520915498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf841094a0 msgr2=0x7fcf8419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf841094a0 0x7fcf8419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 -- 172.21.15.16:0/1520915498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf841a0470 con 0x7fcf84109df0 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf837fe640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b970 tx=0x7fcf7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c019070 con 0x7fcf84109df0 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf841a0760 con 0x7fcf84109df0 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf7c014440 con 0x7fcf84109df0 2024-09-21T00:44:39.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0075d0 con 0x7fcf84109df0 2024-09-21T00:44:39.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.330+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf841a6ec0 con 0x7fcf84109df0 2024-09-21T00:44:39.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.331+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf84103f70 con 0x7fcf84109df0 2024-09-21T00:44:39.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.333+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fcf7c01c070 con 0x7fcf84109df0 2024-09-21T00:44:39.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.333+0000 7fcf6bfff640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 0x7fcf6c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:39.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.334+0000 7fcf82ffd640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 0x7fcf6c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:39.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.334+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fcf7c0e67e0 con 0x7fcf84109df0 2024-09-21T00:44:39.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.334+0000 7fcf82ffd640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 0x7fcf6c0b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf74031440 tx=0x7fcf74009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:39.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.338+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf7c0b14a0 con 0x7fcf84109df0 2024-09-21T00:44:39.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.559+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fcf8410bbf0 con 0x7fcf6c0b65a0 2024-09-21T00:44:39.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.565+0000 7fcf6bfff640 1 -- 172.21.15.16:0/1520915498 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fcf8410bbf0 con 0x7fcf6c0b65a0 2024-09-21T00:44:39.566 INFO:teuthology.orchestra.run.smithi016.stdout:/volumes/qa/sv_1/21cdfe27-aa36-4337-9422-b337c667d3ed 2024-09-21T00:44:39.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 msgr2=0x7fcf6c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:39.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 0x7fcf6c0b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf74031440 tx=0x7fcf74009560 comp rx=0 tx=0).stop 2024-09-21T00:44:39.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 msgr2=0x7fcf8419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:39.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b970 tx=0x7fcf7c00be30 comp rx=0 tx=0).stop 2024-09-21T00:44:39.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 shutdown_connections 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fcf6c0b65a0 0x7fcf6c0b8ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf84109df0 0x7fcf8419fd40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf841094a0 0x7fcf8419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 --2- 172.21.15.16:0/1520915498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf84103b60 0x7fcf8419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 >> 172.21.15.16:0/1520915498 conn(0x7fcf8407b850 msgr2=0x7fcf84107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 shutdown_connections 2024-09-21T00:44:39.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:39.567+0000 7fcf89386640 1 -- 172.21.15.16:0/1520915498 wait complete. 2024-09-21T00:44:39.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:39 smithi016 ceph-mon[30947]: pgmap v299: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-09-21T00:44:40.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:39 smithi178 ceph-mon[34888]: pgmap v299: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-09-21T00:44:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:39 smithi123 ceph-mon[34853]: pgmap v299: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-09-21T00:44:40.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:44:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:41.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:40 smithi178 ceph-mon[34888]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:41.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:40 smithi016 ceph-mon[30947]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:41.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 -- 172.21.15.16:0/4022904721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e01049b0 msgr2=0x7f94e0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:41.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 --2- 172.21.15.16:0/4022904721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e01049b0 0x7f94e0104dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009ca0 tx=0x7f94d002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 -- 172.21.15.16:0/4022904721 shutdown_connections 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 --2- 172.21.15.16:0/4022904721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e010de10 0x7f94e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 --2- 172.21.15.16:0/4022904721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 0x7f94e010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 --2- 172.21.15.16:0/4022904721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e01049b0 0x7f94e0104dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 -- 172.21.15.16:0/4022904721 >> 172.21.15.16:0/4022904721 conn(0x7f94e0079730 msgr2=0x7f94e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 -- 172.21.15.16:0/4022904721 shutdown_connections 2024-09-21T00:44:41.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.145+0000 7f94e587b640 1 -- 172.21.15.16:0/4022904721 wait complete. 2024-09-21T00:44:41.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.146+0000 7f94e587b640 1 Processor -- start 2024-09-21T00:44:41.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.146+0000 7f94e587b640 1 -- start start 2024-09-21T00:44:41.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.146+0000 7f94e587b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 0x7f94e019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:41.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e587b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 0x7f94e019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e587b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e587b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0113a90 con 0x7f94e010de10 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e587b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0113910 con 0x7f94e0105300 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e587b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0113c10 con 0x7f94e01049b0 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60028/0 (socket says 172.21.15.16:60028) 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 -- 172.21.15.16:0/3921912183 learned_addr learned my addr 172.21.15.16:0/3921912183 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94de7fc640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 0x7f94e019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94deffd640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 0x7f94e019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:41.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 -- 172.21.15.16:0/3921912183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 msgr2=0x7f94e019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 0x7f94e019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 -- 172.21.15.16:0/3921912183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 msgr2=0x7f94e019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 0x7f94e019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 -- 172.21.15.16:0/3921912183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e01a0430 con 0x7f94e010de10 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94deffd640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 0x7f94e019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94df7fe640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94d800d750 tx=0x7f94d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.147+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8017070 con 0x7f94e010de10 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.148+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e01a0720 con 0x7f94e010de10 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.148+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d80054d0 con 0x7f94e010de10 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.148+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8004c60 con 0x7f94e010de10 2024-09-21T00:44:41.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.148+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e01a6e80 con 0x7f94e010de10 2024-09-21T00:44:41.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.149+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e0104dc0 con 0x7f94e010de10 2024-09-21T00:44:41.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.150+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f94d8009bd0 con 0x7f94e010de10 2024-09-21T00:44:41.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.151+0000 7f94e4879640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 0x7f94cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:41.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.151+0000 7f94deffd640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 0x7f94cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:41.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.152+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f94d80e6da0 con 0x7f94e010de10 2024-09-21T00:44:41.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.152+0000 7f94deffd640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 0x7f94cc0b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94d00094e0 tx=0x7f94d00093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.156+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94d80ad580 con 0x7f94e010de10 2024-09-21T00:44:41.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:40 smithi123 ceph-mon[34853]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:41.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.381+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94e0108f70 con 0x7f94e010de10 2024-09-21T00:44:41.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.382+0000 7f94e4879640 1 -- 172.21.15.16:0/3921912183 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f94d80b1960 con 0x7f94e010de10 2024-09-21T00:44:41.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:44:41.384 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:44:41.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.384+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 msgr2=0x7f94cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:41.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.384+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 0x7f94cc0b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94d00094e0 tx=0x7f94d00093f0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.384+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 msgr2=0x7f94e019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.384+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94d800d750 tx=0x7f94d800dc10 comp rx=0 tx=0).stop 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 shutdown_connections 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f94cc0b65a0 0x7f94cc0b8ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94e010de10 0x7f94e019fd00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e0105300 0x7f94e019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 --2- 172.21.15.16:0/3921912183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94e01049b0 0x7f94e019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 >> 172.21.15.16:0/3921912183 conn(0x7f94e0079730 msgr2=0x7f94e0100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:41.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 shutdown_connections 2024-09-21T00:44:41.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:41.385+0000 7f94e587b640 1 -- 172.21.15.16:0/3921912183 wait complete. 2024-09-21T00:44:42.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:41 smithi178 ceph-mon[34888]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-21T00:44:42.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:41 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3921912183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:42.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:41 smithi016 ceph-mon[30947]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-21T00:44:42.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:41 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3921912183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:42.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:44:42.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:41 smithi123 ceph-mon[34853]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-09-21T00:44:42.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:41 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3921912183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:44:42.360 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 -- 172.21.15.16:0/2167402222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac102470 msgr2=0x7f5bac102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 --2- 172.21.15.16:0/2167402222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac102470 0x7f5bac102880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009ca0 tx=0x7f5b9c02a950 comp rx=0 tx=0).stop 2024-09-21T00:44:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 -- 172.21.15.16:0/2167402222 shutdown_connections 2024-09-21T00:44:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 --2- 172.21.15.16:0/2167402222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac110020 0x7f5bac112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 --2- 172.21.15.16:0/2167402222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102dc0 0x7f5bac10fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 --2- 172.21.15.16:0/2167402222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac102470 0x7f5bac102880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 -- 172.21.15.16:0/2167402222 >> 172.21.15.16:0/2167402222 conn(0x7f5bac0fe2d0 msgr2=0x7f5bac100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 -- 172.21.15.16:0/2167402222 shutdown_connections 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.812+0000 7f5bab59e640 1 -- 172.21.15.16:0/2167402222 wait complete. 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 Processor -- start 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 -- start start 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 0x7f5bac19c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac102dc0 0x7f5bac19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac115a90 con 0x7f5bac110020 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac115910 con 0x7f5bac102470 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.813+0000 7f5bab59e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac115c10 con 0x7f5bac102dc0 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60046/0 (socket says 172.21.15.16:60046) 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 -- 172.21.15.16:0/4276292090 learned_addr learned my addr 172.21.15.16:0/4276292090 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5ba9d9b640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac102dc0 0x7f5bac19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baa59c640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 0x7f5bac19c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 -- 172.21.15.16:0/4276292090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac102dc0 msgr2=0x7f5bac19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac102dc0 0x7f5bac19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 -- 172.21.15.16:0/4276292090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 msgr2=0x7f5bac19c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 0x7f5bac19c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 -- 172.21.15.16:0/4276292090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac1a2330 con 0x7f5bac110020 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baa59c640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 0x7f5bac19c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5baad9d640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c970 tx=0x7f5ba400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4007bb0 con 0x7f5bac110020 2024-09-21T00:44:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac1a2620 con 0x7f5bac110020 2024-09-21T00:44:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ba4007d50 con 0x7f5bac110020 2024-09-21T00:44:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4018770 con 0x7f5bac110020 2024-09-21T00:44:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.814+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac1a8e40 con 0x7f5bac110020 2024-09-21T00:44:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.815+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac06bf80 con 0x7f5bac110020 2024-09-21T00:44:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.817+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5ba400f990 con 0x7f5bac110020 2024-09-21T00:44:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.818+0000 7f5ba37fe640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 0x7f5b980b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.818+0000 7f5baa59c640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 0x7f5b980b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.818+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f5ba40e7410 con 0x7f5bac110020 2024-09-21T00:44:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.818+0000 7f5baa59c640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 0x7f5b980b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005cc0 tx=0x7f5b9c005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:42.821+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ba4014030 con 0x7f5bac110020 2024-09-21T00:44:43.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.010+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bac10b1b0 con 0x7f5bac110020 2024-09-21T00:44:43.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.012+0000 7f5ba37fe640 1 -- 172.21.15.16:0/4276292090 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22293 (secure 0 0 0) 0x7f5ba40add80 con 0x7f5bac110020 2024-09-21T00:44:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:43.014 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":73,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:18.388858+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:44:43.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 msgr2=0x7f5b980b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:43.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 0x7f5b980b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005cc0 tx=0x7f5b9c005c30 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 msgr2=0x7f5bac1a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c970 tx=0x7f5ba400ce30 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 shutdown_connections 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5b980b65d0 0x7f5b980b8ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bac110020 0x7f5bac1a1cc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac102dc0 0x7f5bac19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 --2- 172.21.15.16:0/4276292090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bac102470 0x7f5bac19c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 >> 172.21.15.16:0/4276292090 conn(0x7f5bac0fe2d0 msgr2=0x7f5bac1121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 shutdown_connections 2024-09-21T00:44:43.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:43.014+0000 7f5bab59e640 1 -- 172.21.15.16:0/4276292090 wait complete. 2024-09-21T00:44:43.770 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:44:43.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:44:44.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:43 smithi016 ceph-mon[30947]: pgmap v301: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-09-21T00:44:44.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:43 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4276292090' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:44.034 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:43 smithi178 ceph-mon[34888]: pgmap v301: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-09-21T00:44:44.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:43 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4276292090' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:44.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:43 smithi123 ceph-mon[34853]: pgmap v301: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 KiB/s wr, 24 op/s 2024-09-21T00:44:44.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:43 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4276292090' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- 172.21.15.16:0/207224568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e501083d0 msgr2=0x7f8e501087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 --2- 172.21.15.16:0/207224568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e501083d0 0x7f8e501087e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009900 tx=0x7f8e4402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- 172.21.15.16:0/207224568 shutdown_connections 2024-09-21T00:44:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 --2- 172.21.15.16:0/207224568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e50108d20 0x7f8e5010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 --2- 172.21.15.16:0/207224568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e501083d0 0x7f8e501087e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 --2- 172.21.15.16:0/207224568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50102ae0 0x7f8e50102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- 172.21.15.16:0/207224568 >> 172.21.15.16:0/207224568 conn(0x7f8e50079760 msgr2=0x7f8e50079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- 172.21.15.16:0/207224568 shutdown_connections 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- 172.21.15.16:0/207224568 wait complete. 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 Processor -- start 2024-09-21T00:44:44.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.520+0000 7f8e563d1640 1 -- start start 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e501083d0 0x7f8e5019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50108d20 0x7f8e5019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50112990 con 0x7f8e50102ae0 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50112810 con 0x7f8e50108d20 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e563d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50112b10 con 0x7f8e501083d0 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36478/0 (socket says 172.21.15.16:36478) 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 -- 172.21.15.16:0/2487964783 learned_addr learned my addr 172.21.15.16:0/2487964783 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4f7fe640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e501083d0 0x7f8e5019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e5496e640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50108d20 0x7f8e5019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:44.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 -- 172.21.15.16:0/2487964783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e501083d0 msgr2=0x7f8e5019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e501083d0 0x7f8e5019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 -- 172.21.15.16:0/2487964783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50108d20 msgr2=0x7f8e5019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50108d20 0x7f8e5019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.521+0000 7f8e4ffff640 1 -- 172.21.15.16:0/2487964783 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e501a0480 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e4ffff640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c890 tx=0x7f8e4000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40004220 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e400043c0 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e501a0770 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40004a00 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.522+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e501a6ed0 con 0x7f8e50102ae0 2024-09-21T00:44:44.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.523+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50103d10 con 0x7f8e50102ae0 2024-09-21T00:44:44.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.525+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8e400079b0 con 0x7f8e50102ae0 2024-09-21T00:44:44.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.526+0000 7f8e4d7fa640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 0x7f8e380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:44.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.526+0000 7f8e4f7fe640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 0x7f8e380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:44.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.526+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8e400e74d0 con 0x7f8e50102ae0 2024-09-21T00:44:44.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.526+0000 7f8e4f7fe640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 0x7f8e380b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e44031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:44.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.529+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e40014030 con 0x7f8e50102ae0 2024-09-21T00:44:44.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.713+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e5010bb60 con 0x7f8e380b65a0 2024-09-21T00:44:44.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.720+0000 7f8e4d7fa640 1 -- 172.21.15.16:0/2487964783 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258900 (secure 0 0 0) 0x7f8e5010bb60 con 0x7f8e380b65a0 2024-09-21T00:44:44.723 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:44.724 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 msgr2=0x7f8e380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 0x7f8e380b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e44031400 comp rx=0 tx=0).stop 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 msgr2=0x7f8e5019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c890 tx=0x7f8e4000cd50 comp rx=0 tx=0).stop 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 shutdown_connections 2024-09-21T00:44:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8e380b65a0 0x7f8e380b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e50108d20 0x7f8e5019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e501083d0 0x7f8e5019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 --2- 172.21.15.16:0/2487964783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e50102ae0 0x7f8e5019a510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 >> 172.21.15.16:0/2487964783 conn(0x7f8e50079760 msgr2=0x7f8e5006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 shutdown_connections 2024-09-21T00:44:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:44.724+0000 7f8e563d1640 1 -- 172.21.15.16:0/2487964783 wait complete. 2024-09-21T00:44:45.494 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-21T00:44:44.260231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643400,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":224,"num_read_kb":197,"num_write":356,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379936,"kb_used_data":9888,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561888,"statfs":{"total":1151940427776,"available":1151551373312,"internally_reserved":0,"allocated":10125312,"data_stored":6509532,"data_compressed":108978,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46258,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":117,"num_read_kb":106,"num_write":41,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002993"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694630+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:44:18.694630+0000","last_peered":"2024-09-21T00:44:18.694630+0000","last_clean":"2024-09-21T00:44:18.694630+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:44:18.694630+0000","last_undegraded":"2024-09-21T00:44:18.694630+0000","last_fullsized":"2024-09-21T00:44:18.694630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694770+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:44:18.694770+0000","last_peered":"2024-09-21T00:44:18.694770+0000","last_clean":"2024-09-21T00:44:18.694770+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:44:18.694770+0000","last_undegraded":"2024-09-21T00:44:18.694770+0000","last_fullsized":"2024-09-21T00:44:18.694770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694497+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:44:18.694497+0000","last_peered":"2024-09-21T00:44:18.694497+0000","last_clean":"2024-09-21T00:44:18.694497+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:44:18.694497+0000","last_undegraded":"2024-09-21T00:44:18.694497+0000","last_fullsized":"2024-09-21T00:44:18.694497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690204+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:44:18.690204+0000","last_peered":"2024-09-21T00:44:18.690204+0000","last_clean":"2024-09-21T00:44:18.690204+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:44:18.690204+0000","last_undegraded":"2024-09-21T00:44:18.690204+0000","last_fullsized":"2024-09-21T00:44:18.690204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689636+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:44:18.689636+0000","last_peered":"2024-09-21T00:44:18.689636+0000","last_clean":"2024-09-21T00:44:18.689636+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:44:18.689636+0000","last_undegraded":"2024-09-21T00:44:18.689636+0000","last_fullsized":"2024-09-21T00:44:18.689636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689713+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:44:18.689713+0000","last_peered":"2024-09-21T00:44:18.689713+0000","last_clean":"2024-09-21T00:44:18.689713+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:44:18.689713+0000","last_undegraded":"2024-09-21T00:44:18.689713+0000","last_fullsized":"2024-09-21T00:44:18.689713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694630+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:44:18.694630+0000","last_peered":"2024-09-21T00:44:18.694630+0000","last_clean":"2024-09-21T00:44:18.694630+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:44:18.694630+0000","last_undegraded":"2024-09-21T00:44:18.694630+0000","last_fullsized":"2024-09-21T00:44:18.694630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690649+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:44:18.690649+0000","last_peered":"2024-09-21T00:44:18.690649+0000","last_clean":"2024-09-21T00:44:18.690649+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:44:18.690649+0000","last_undegraded":"2024-09-21T00:44:18.690649+0000","last_fullsized":"2024-09-21T00:44:18.690649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673794+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:44:18.673794+0000","last_peered":"2024-09-21T00:44:18.673794+0000","last_clean":"2024-09-21T00:44:18.673794+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:44:18.673794+0000","last_undegraded":"2024-09-21T00:44:18.673794+0000","last_fullsized":"2024-09-21T00:44:18.673794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690822+0000","last_change":"2024-09-21T00:44:17.688705+0000","last_active":"2024-09-21T00:44:18.690822+0000","last_peered":"2024-09-21T00:44:18.690822+0000","last_clean":"2024-09-21T00:44:18.690822+0000","last_became_active":"2024-09-21T00:44:17.688342+0000","last_became_peered":"2024-09-21T00:44:17.688342+0000","last_unstale":"2024-09-21T00:44:18.690822+0000","last_undegraded":"2024-09-21T00:44:18.690822+0000","last_fullsized":"2024-09-21T00:44:18.690822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:58.758321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693944+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:44:18.693944+0000","last_peered":"2024-09-21T00:44:18.693944+0000","last_clean":"2024-09-21T00:44:18.693944+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:44:18.693944+0000","last_undegraded":"2024-09-21T00:44:18.693944+0000","last_fullsized":"2024-09-21T00:44:18.693944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690422+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:44:18.690422+0000","last_peered":"2024-09-21T00:44:18.690422+0000","last_clean":"2024-09-21T00:44:18.690422+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:44:18.690422+0000","last_undegraded":"2024-09-21T00:44:18.690422+0000","last_fullsized":"2024-09-21T00:44:18.690422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669118+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:44:18.669118+0000","last_peered":"2024-09-21T00:44:18.669118+0000","last_clean":"2024-09-21T00:44:18.669118+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:44:18.669118+0000","last_undegraded":"2024-09-21T00:44:18.669118+0000","last_fullsized":"2024-09-21T00:44:18.669118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694591+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:44:18.694591+0000","last_peered":"2024-09-21T00:44:18.694591+0000","last_clean":"2024-09-21T00:44:18.694591+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:44:18.694591+0000","last_undegraded":"2024-09-21T00:44:18.694591+0000","last_fullsized":"2024-09-21T00:44:18.694591+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694488+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:44:18.694488+0000","last_peered":"2024-09-21T00:44:18.694488+0000","last_clean":"2024-09-21T00:44:18.694488+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:44:18.694488+0000","last_undegraded":"2024-09-21T00:44:18.694488+0000","last_fullsized":"2024-09-21T00:44:18.694488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673155+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:44:18.673155+0000","last_peered":"2024-09-21T00:44:18.673155+0000","last_clean":"2024-09-21T00:44:18.673155+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:44:18.673155+0000","last_undegraded":"2024-09-21T00:44:18.673155+0000","last_fullsized":"2024-09-21T00:44:18.673155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694724+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:44:18.694724+0000","last_peered":"2024-09-21T00:44:18.694724+0000","last_clean":"2024-09-21T00:44:18.694724+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:44:18.694724+0000","last_undegraded":"2024-09-21T00:44:18.694724+0000","last_fullsized":"2024-09-21T00:44:18.694724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689437+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:44:18.689437+0000","last_peered":"2024-09-21T00:44:18.689437+0000","last_clean":"2024-09-21T00:44:18.689437+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:44:18.689437+0000","last_undegraded":"2024-09-21T00:44:18.689437+0000","last_fullsized":"2024-09-21T00:44:18.689437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669724+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:44:18.669724+0000","last_peered":"2024-09-21T00:44:18.669724+0000","last_clean":"2024-09-21T00:44:18.669724+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:44:18.669724+0000","last_undegraded":"2024-09-21T00:44:18.669724+0000","last_fullsized":"2024-09-21T00:44:18.669724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693827+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:44:18.693827+0000","last_peered":"2024-09-21T00:44:18.693827+0000","last_clean":"2024-09-21T00:44:18.693827+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:44:18.693827+0000","last_undegraded":"2024-09-21T00:44:18.693827+0000","last_fullsized":"2024-09-21T00:44:18.693827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669344+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:44:18.669344+0000","last_peered":"2024-09-21T00:44:18.669344+0000","last_clean":"2024-09-21T00:44:18.669344+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:44:18.669344+0000","last_undegraded":"2024-09-21T00:44:18.669344+0000","last_fullsized":"2024-09-21T00:44:18.669344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673506+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:44:18.673506+0000","last_peered":"2024-09-21T00:44:18.673506+0000","last_clean":"2024-09-21T00:44:18.673506+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:44:18.673506+0000","last_undegraded":"2024-09-21T00:44:18.673506+0000","last_fullsized":"2024-09-21T00:44:18.673506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690202+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:44:18.690202+0000","last_peered":"2024-09-21T00:44:18.690202+0000","last_clean":"2024-09-21T00:44:18.690202+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:44:18.690202+0000","last_undegraded":"2024-09-21T00:44:18.690202+0000","last_fullsized":"2024-09-21T00:44:18.690202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689996+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:44:18.689996+0000","last_peered":"2024-09-21T00:44:18.689996+0000","last_clean":"2024-09-21T00:44:18.689996+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:44:18.689996+0000","last_undegraded":"2024-09-21T00:44:18.689996+0000","last_fullsized":"2024-09-21T00:44:18.689996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691828+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:44:18.691828+0000","last_peered":"2024-09-21T00:44:18.691828+0000","last_clean":"2024-09-21T00:44:18.691828+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:44:18.691828+0000","last_undegraded":"2024-09-21T00:44:18.691828+0000","last_fullsized":"2024-09-21T00:44:18.691828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669983+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:44:18.669983+0000","last_peered":"2024-09-21T00:44:18.669983+0000","last_clean":"2024-09-21T00:44:18.669983+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:44:18.669983+0000","last_undegraded":"2024-09-21T00:44:18.669983+0000","last_fullsized":"2024-09-21T00:44:18.669983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694197+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:44:18.694197+0000","last_peered":"2024-09-21T00:44:18.694197+0000","last_clean":"2024-09-21T00:44:18.694197+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:44:18.694197+0000","last_undegraded":"2024-09-21T00:44:18.694197+0000","last_fullsized":"2024-09-21T00:44:18.694197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668907+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:44:18.668907+0000","last_peered":"2024-09-21T00:44:18.668907+0000","last_clean":"2024-09-21T00:44:18.668907+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:44:18.668907+0000","last_undegraded":"2024-09-21T00:44:18.668907+0000","last_fullsized":"2024-09-21T00:44:18.668907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694719+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:44:18.694719+0000","last_peered":"2024-09-21T00:44:18.694719+0000","last_clean":"2024-09-21T00:44:18.694719+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:44:18.694719+0000","last_undegraded":"2024-09-21T00:44:18.694719+0000","last_fullsized":"2024-09-21T00:44:18.694719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669910+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:44:18.669910+0000","last_peered":"2024-09-21T00:44:18.669910+0000","last_clean":"2024-09-21T00:44:18.669910+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:44:18.669910+0000","last_undegraded":"2024-09-21T00:44:18.669910+0000","last_fullsized":"2024-09-21T00:44:18.669910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669670+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:44:18.669670+0000","last_peered":"2024-09-21T00:44:18.669670+0000","last_clean":"2024-09-21T00:44:18.669670+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:44:18.669670+0000","last_undegraded":"2024-09-21T00:44:18.669670+0000","last_fullsized":"2024-09-21T00:44:18.669670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693909+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:44:18.693909+0000","last_peered":"2024-09-21T00:44:18.693909+0000","last_clean":"2024-09-21T00:44:18.693909+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:44:18.693909+0000","last_undegraded":"2024-09-21T00:44:18.693909+0000","last_fullsized":"2024-09-21T00:44:18.693909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689407+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:44:18.689407+0000","last_peered":"2024-09-21T00:44:18.689407+0000","last_clean":"2024-09-21T00:44:18.689407+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:44:18.689407+0000","last_undegraded":"2024-09-21T00:44:18.689407+0000","last_fullsized":"2024-09-21T00:44:18.689407+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:41.781022+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:44:41.781022+0000","last_peered":"2024-09-21T00:44:41.781022+0000","last_clean":"2024-09-21T00:44:41.781022+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:44:41.781022+0000","last_undegraded":"2024-09-21T00:44:41.781022+0000","last_fullsized":"2024-09-21T00:44:41.781022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690456+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:44:18.690456+0000","last_peered":"2024-09-21T00:44:18.690456+0000","last_clean":"2024-09-21T00:44:18.690456+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:44:18.690456+0000","last_undegraded":"2024-09-21T00:44:18.690456+0000","last_fullsized":"2024-09-21T00:44:18.690456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.747658+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:28.747658+0000","last_peered":"2024-09-21T00:44:28.747658+0000","last_clean":"2024-09-21T00:44:28.747658+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:28.747658+0000","last_undegraded":"2024-09-21T00:44:28.747658+0000","last_fullsized":"2024-09-21T00:44:28.747658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:27.740726+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:27.740726+0000","last_peered":"2024-09-21T00:44:27.740726+0000","last_clean":"2024-09-21T00:44:27.740726+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:27.740726+0000","last_undegraded":"2024-09-21T00:44:27.740726+0000","last_fullsized":"2024-09-21T00:44:27.740726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690476+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:44:18.690476+0000","last_peered":"2024-09-21T00:44:18.690476+0000","last_clean":"2024-09-21T00:44:18.690476+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:44:18.690476+0000","last_undegraded":"2024-09-21T00:44:18.690476+0000","last_fullsized":"2024-09-21T00:44:18.690476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753590+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:29.753590+0000","last_peered":"2024-09-21T00:44:29.753590+0000","last_clean":"2024-09-21T00:44:29.753590+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:29.753590+0000","last_undegraded":"2024-09-21T00:44:29.753590+0000","last_fullsized":"2024-09-21T00:44:29.753590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689482+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:44:18.689482+0000","last_peered":"2024-09-21T00:44:18.689482+0000","last_clean":"2024-09-21T00:44:18.689482+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:44:18.689482+0000","last_undegraded":"2024-09-21T00:44:18.689482+0000","last_fullsized":"2024-09-21T00:44:18.689482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.778745+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:44:40.778745+0000","last_peered":"2024-09-21T00:44:40.778745+0000","last_clean":"2024-09-21T00:44:40.778745+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:44:40.778745+0000","last_undegraded":"2024-09-21T00:44:40.778745+0000","last_fullsized":"2024-09-21T00:44:40.778745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673786+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:44:18.673786+0000","last_peered":"2024-09-21T00:44:18.673786+0000","last_clean":"2024-09-21T00:44:18.673786+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:44:18.673786+0000","last_undegraded":"2024-09-21T00:44:18.673786+0000","last_fullsized":"2024-09-21T00:44:18.673786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.752206+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:29.752206+0000","last_peered":"2024-09-21T00:44:29.752206+0000","last_clean":"2024-09-21T00:44:29.752206+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:29.752206+0000","last_undegraded":"2024-09-21T00:44:29.752206+0000","last_fullsized":"2024-09-21T00:44:29.752206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694791+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:44:18.694791+0000","last_peered":"2024-09-21T00:44:18.694791+0000","last_clean":"2024-09-21T00:44:18.694791+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:44:18.694791+0000","last_undegraded":"2024-09-21T00:44:18.694791+0000","last_fullsized":"2024-09-21T00:44:18.694791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.747886+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:28.747886+0000","last_peered":"2024-09-21T00:44:28.747886+0000","last_clean":"2024-09-21T00:44:28.747886+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:28.747886+0000","last_undegraded":"2024-09-21T00:44:28.747886+0000","last_fullsized":"2024-09-21T00:44:28.747886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673581+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:44:18.673581+0000","last_peered":"2024-09-21T00:44:18.673581+0000","last_clean":"2024-09-21T00:44:18.673581+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:44:18.673581+0000","last_undegraded":"2024-09-21T00:44:18.673581+0000","last_fullsized":"2024-09-21T00:44:18.673581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'23","reported_seq":69,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.780689+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:44:40.780689+0000","last_peered":"2024-09-21T00:44:40.780689+0000","last_clean":"2024-09-21T00:44:40.780689+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:44:40.780689+0000","last_undegraded":"2024-09-21T00:44:40.780689+0000","last_fullsized":"2024-09-21T00:44:40.780689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":57,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691549+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:44:18.691549+0000","last_peered":"2024-09-21T00:44:18.691549+0000","last_clean":"2024-09-21T00:44:18.691549+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:44:18.691549+0000","last_undegraded":"2024-09-21T00:44:18.691549+0000","last_fullsized":"2024-09-21T00:44:18.691549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.760526+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:30.760526+0000","last_peered":"2024-09-21T00:44:30.760526+0000","last_clean":"2024-09-21T00:44:30.760526+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:30.760526+0000","last_undegraded":"2024-09-21T00:44:30.760526+0000","last_fullsized":"2024-09-21T00:44:30.760526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668526+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:44:18.668526+0000","last_peered":"2024-09-21T00:44:18.668526+0000","last_clean":"2024-09-21T00:44:18.668526+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:44:18.668526+0000","last_undegraded":"2024-09-21T00:44:18.668526+0000","last_fullsized":"2024-09-21T00:44:18.668526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753110+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:29.753110+0000","last_peered":"2024-09-21T00:44:29.753110+0000","last_clean":"2024-09-21T00:44:29.753110+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:29.753110+0000","last_undegraded":"2024-09-21T00:44:29.753110+0000","last_fullsized":"2024-09-21T00:44:29.753110+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695405+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:44:18.695405+0000","last_peered":"2024-09-21T00:44:18.695405+0000","last_clean":"2024-09-21T00:44:18.695405+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:44:18.695405+0000","last_undegraded":"2024-09-21T00:44:18.695405+0000","last_fullsized":"2024-09-21T00:44:18.695405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.779597+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:44:40.779597+0000","last_peered":"2024-09-21T00:44:40.779597+0000","last_clean":"2024-09-21T00:44:40.779597+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:44:40.779597+0000","last_undegraded":"2024-09-21T00:44:40.779597+0000","last_fullsized":"2024-09-21T00:44:40.779597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693823+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:44:18.693823+0000","last_peered":"2024-09-21T00:44:18.693823+0000","last_clean":"2024-09-21T00:44:18.693823+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:44:18.693823+0000","last_undegraded":"2024-09-21T00:44:18.693823+0000","last_fullsized":"2024-09-21T00:44:18.693823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.754479+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:29.754479+0000","last_peered":"2024-09-21T00:44:29.754479+0000","last_clean":"2024-09-21T00:44:29.754479+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:29.754479+0000","last_undegraded":"2024-09-21T00:44:29.754479+0000","last_fullsized":"2024-09-21T00:44:29.754479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689717+0000","last_change":"2024-09-21T00:44:17.683527+0000","last_active":"2024-09-21T00:44:18.689717+0000","last_peered":"2024-09-21T00:44:18.689717+0000","last_clean":"2024-09-21T00:44:18.689717+0000","last_became_active":"2024-09-21T00:44:17.682930+0000","last_became_peered":"2024-09-21T00:44:17.682930+0000","last_unstale":"2024-09-21T00:44:18.689717+0000","last_undegraded":"2024-09-21T00:44:18.689717+0000","last_fullsized":"2024-09-21T00:44:18.689717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:46.139553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.735271+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:28.735271+0000","last_peered":"2024-09-21T00:44:28.735271+0000","last_clean":"2024-09-21T00:44:28.735271+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:28.735271+0000","last_undegraded":"2024-09-21T00:44:28.735271+0000","last_fullsized":"2024-09-21T00:44:28.735271+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693644+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:44:18.693644+0000","last_peered":"2024-09-21T00:44:18.693644+0000","last_clean":"2024-09-21T00:44:18.693644+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:44:18.693644+0000","last_undegraded":"2024-09-21T00:44:18.693644+0000","last_fullsized":"2024-09-21T00:44:18.693644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.750825+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:29.750825+0000","last_peered":"2024-09-21T00:44:29.750825+0000","last_clean":"2024-09-21T00:44:29.750825+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:29.750825+0000","last_undegraded":"2024-09-21T00:44:29.750825+0000","last_fullsized":"2024-09-21T00:44:29.750825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695027+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:44:18.695027+0000","last_peered":"2024-09-21T00:44:18.695027+0000","last_clean":"2024-09-21T00:44:18.695027+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:44:18.695027+0000","last_undegraded":"2024-09-21T00:44:18.695027+0000","last_fullsized":"2024-09-21T00:44:18.695027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753267+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:29.753267+0000","last_peered":"2024-09-21T00:44:29.753267+0000","last_clean":"2024-09-21T00:44:29.753267+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:29.753267+0000","last_undegraded":"2024-09-21T00:44:29.753267+0000","last_fullsized":"2024-09-21T00:44:29.753267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:19.306526+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:44:19.306526+0000","last_peered":"2024-09-21T00:44:19.306526+0000","last_clean":"2024-09-21T00:44:19.306526+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:44:19.306526+0000","last_undegraded":"2024-09-21T00:44:19.306526+0000","last_fullsized":"2024-09-21T00:44:19.306526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:39.778146+0000","last_change":"2024-09-21T00:44:16.130811+0000","last_active":"2024-09-21T00:44:39.778146+0000","last_peered":"2024-09-21T00:44:39.778146+0000","last_clean":"2024-09-21T00:44:39.778146+0000","last_became_active":"2024-09-21T00:44:16.130251+0000","last_became_peered":"2024-09-21T00:44:16.130251+0000","last_unstale":"2024-09-21T00:44:39.778146+0000","last_undegraded":"2024-09-21T00:44:39.778146+0000","last_fullsized":"2024-09-21T00:44:39.778146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:04:29.311797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694186+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:44:18.694186+0000","last_peered":"2024-09-21T00:44:18.694186+0000","last_clean":"2024-09-21T00:44:18.694186+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:44:18.694186+0000","last_undegraded":"2024-09-21T00:44:18.694186+0000","last_fullsized":"2024-09-21T00:44:18.694186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":94,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694264+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:18.694264+0000","last_peered":"2024-09-21T00:44:18.694264+0000","last_clean":"2024-09-21T00:44:18.694264+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:18.694264+0000","last_undegraded":"2024-09-21T00:44:18.694264+0000","last_fullsized":"2024-09-21T00:44:18.694264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.760276+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:30.760276+0000","last_peered":"2024-09-21T00:44:30.760276+0000","last_clean":"2024-09-21T00:44:30.760276+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:30.760276+0000","last_undegraded":"2024-09-21T00:44:30.760276+0000","last_fullsized":"2024-09-21T00:44:30.760276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690366+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:44:18.690366+0000","last_peered":"2024-09-21T00:44:18.690366+0000","last_clean":"2024-09-21T00:44:18.690366+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:44:18.690366+0000","last_undegraded":"2024-09-21T00:44:18.690366+0000","last_fullsized":"2024-09-21T00:44:18.690366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:27.741329+0000","last_change":"2024-09-21T00:44:15.660111+0000","last_active":"2024-09-21T00:44:27.741329+0000","last_peered":"2024-09-21T00:44:27.741329+0000","last_clean":"2024-09-21T00:44:27.741329+0000","last_became_active":"2024-09-21T00:44:15.659689+0000","last_became_peered":"2024-09-21T00:44:15.659689+0000","last_unstale":"2024-09-21T00:44:27.741329+0000","last_undegraded":"2024-09-21T00:44:27.741329+0000","last_fullsized":"2024-09-21T00:44:27.741329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:04.887245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668539+0000","last_change":"2024-09-21T00:44:17.679905+0000","last_active":"2024-09-21T00:44:18.668539+0000","last_peered":"2024-09-21T00:44:18.668539+0000","last_clean":"2024-09-21T00:44:18.668539+0000","last_became_active":"2024-09-21T00:44:17.679512+0000","last_became_peered":"2024-09-21T00:44:17.679512+0000","last_unstale":"2024-09-21T00:44:18.668539+0000","last_undegraded":"2024-09-21T00:44:18.668539+0000","last_fullsized":"2024-09-21T00:44:18.668539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:35.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:38.776313+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:44:38.776313+0000","last_peered":"2024-09-21T00:44:38.776313+0000","last_clean":"2024-09-21T00:44:38.776313+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:44:38.776313+0000","last_undegraded":"2024-09-21T00:44:38.776313+0000","last_fullsized":"2024-09-21T00:44:38.776313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690233+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:44:18.690233+0000","last_peered":"2024-09-21T00:44:18.690233+0000","last_clean":"2024-09-21T00:44:18.690233+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:44:18.690233+0000","last_undegraded":"2024-09-21T00:44:18.690233+0000","last_fullsized":"2024-09-21T00:44:18.690233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:37.774813+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:44:37.774813+0000","last_peered":"2024-09-21T00:44:37.774813+0000","last_clean":"2024-09-21T00:44:37.774813+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:44:37.774813+0000","last_undegraded":"2024-09-21T00:44:37.774813+0000","last_fullsized":"2024-09-21T00:44:37.774813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689930+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:44:18.689930+0000","last_peered":"2024-09-21T00:44:18.689930+0000","last_clean":"2024-09-21T00:44:18.689930+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:44:18.689930+0000","last_undegraded":"2024-09-21T00:44:18.689930+0000","last_fullsized":"2024-09-21T00:44:18.689930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689116+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:18.689116+0000","last_peered":"2024-09-21T00:44:18.689116+0000","last_clean":"2024-09-21T00:44:18.689116+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:18.689116+0000","last_undegraded":"2024-09-21T00:44:18.689116+0000","last_fullsized":"2024-09-21T00:44:18.689116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:21.569555+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:44:21.569555+0000","last_peered":"2024-09-21T00:44:21.569555+0000","last_clean":"2024-09-21T00:44:21.569555+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:44:21.569555+0000","last_undegraded":"2024-09-21T00:44:21.569555+0000","last_fullsized":"2024-09-21T00:44:21.569555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.754432+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:29.754432+0000","last_peered":"2024-09-21T00:44:29.754432+0000","last_clean":"2024-09-21T00:44:29.754432+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:29.754432+0000","last_undegraded":"2024-09-21T00:44:29.754432+0000","last_fullsized":"2024-09-21T00:44:29.754432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668888+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:44:18.668888+0000","last_peered":"2024-09-21T00:44:18.668888+0000","last_clean":"2024-09-21T00:44:18.668888+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:44:18.668888+0000","last_undegraded":"2024-09-21T00:44:18.668888+0000","last_fullsized":"2024-09-21T00:44:18.668888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'12","reported_seq":31,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:38.688392+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:44:38.688392+0000","last_peered":"2024-09-21T00:44:38.688392+0000","last_clean":"2024-09-21T00:44:38.688392+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:44:38.688392+0000","last_undegraded":"2024-09-21T00:44:38.688392+0000","last_fullsized":"2024-09-21T00:44:38.688392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691629+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:44:18.691629+0000","last_peered":"2024-09-21T00:44:18.691629+0000","last_clean":"2024-09-21T00:44:18.691629+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:44:18.691629+0000","last_undegraded":"2024-09-21T00:44:18.691629+0000","last_fullsized":"2024-09-21T00:44:18.691629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753143+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:29.753143+0000","last_peered":"2024-09-21T00:44:29.753143+0000","last_clean":"2024-09-21T00:44:29.753143+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:29.753143+0000","last_undegraded":"2024-09-21T00:44:29.753143+0000","last_fullsized":"2024-09-21T00:44:29.753143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694928+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:44:18.694928+0000","last_peered":"2024-09-21T00:44:18.694928+0000","last_clean":"2024-09-21T00:44:18.694928+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:44:18.694928+0000","last_undegraded":"2024-09-21T00:44:18.694928+0000","last_fullsized":"2024-09-21T00:44:18.694928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:26.735137+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:26.735137+0000","last_peered":"2024-09-21T00:44:26.735137+0000","last_clean":"2024-09-21T00:44:26.735137+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:26.735137+0000","last_undegraded":"2024-09-21T00:44:26.735137+0000","last_fullsized":"2024-09-21T00:44:26.735137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689258+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:44:18.689258+0000","last_peered":"2024-09-21T00:44:18.689258+0000","last_clean":"2024-09-21T00:44:18.689258+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:44:18.689258+0000","last_undegraded":"2024-09-21T00:44:18.689258+0000","last_fullsized":"2024-09-21T00:44:18.689258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.750844+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:29.750844+0000","last_peered":"2024-09-21T00:44:29.750844+0000","last_clean":"2024-09-21T00:44:29.750844+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:29.750844+0000","last_undegraded":"2024-09-21T00:44:29.750844+0000","last_fullsized":"2024-09-21T00:44:29.750844+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693700+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:44:18.693700+0000","last_peered":"2024-09-21T00:44:18.693700+0000","last_clean":"2024-09-21T00:44:18.693700+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:44:18.693700+0000","last_undegraded":"2024-09-21T00:44:18.693700+0000","last_fullsized":"2024-09-21T00:44:18.693700+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.749230+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:28.749230+0000","last_peered":"2024-09-21T00:44:28.749230+0000","last_clean":"2024-09-21T00:44:28.749230+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:28.749230+0000","last_undegraded":"2024-09-21T00:44:28.749230+0000","last_fullsized":"2024-09-21T00:44:28.749230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691095+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:44:18.691095+0000","last_peered":"2024-09-21T00:44:18.691095+0000","last_clean":"2024-09-21T00:44:18.691095+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:44:18.691095+0000","last_undegraded":"2024-09-21T00:44:18.691095+0000","last_fullsized":"2024-09-21T00:44:18.691095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:26.734976+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:26.734976+0000","last_peered":"2024-09-21T00:44:26.734976+0000","last_clean":"2024-09-21T00:44:26.734976+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:26.734976+0000","last_undegraded":"2024-09-21T00:44:26.734976+0000","last_fullsized":"2024-09-21T00:44:26.734976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695061+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:44:18.695061+0000","last_peered":"2024-09-21T00:44:18.695061+0000","last_clean":"2024-09-21T00:44:18.695061+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:44:18.695061+0000","last_undegraded":"2024-09-21T00:44:18.695061+0000","last_fullsized":"2024-09-21T00:44:18.695061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.696978+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:44:18.696978+0000","last_peered":"2024-09-21T00:44:18.696978+0000","last_clean":"2024-09-21T00:44:18.696978+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:44:18.696978+0000","last_undegraded":"2024-09-21T00:44:18.696978+0000","last_fullsized":"2024-09-21T00:44:18.696978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753150+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:29.753150+0000","last_peered":"2024-09-21T00:44:29.753150+0000","last_clean":"2024-09-21T00:44:29.753150+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:29.753150+0000","last_undegraded":"2024-09-21T00:44:29.753150+0000","last_fullsized":"2024-09-21T00:44:29.753150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673220+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:44:18.673220+0000","last_peered":"2024-09-21T00:44:18.673220+0000","last_clean":"2024-09-21T00:44:18.673220+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:44:18.673220+0000","last_undegraded":"2024-09-21T00:44:18.673220+0000","last_fullsized":"2024-09-21T00:44:18.673220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.762081+0000","last_change":"2024-09-21T00:44:15.662976+0000","last_active":"2024-09-21T00:44:30.762081+0000","last_peered":"2024-09-21T00:44:30.762081+0000","last_clean":"2024-09-21T00:44:30.762081+0000","last_became_active":"2024-09-21T00:44:15.662506+0000","last_became_peered":"2024-09-21T00:44:15.662506+0000","last_unstale":"2024-09-21T00:44:30.762081+0000","last_undegraded":"2024-09-21T00:44:30.762081+0000","last_fullsized":"2024-09-21T00:44:30.762081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:18.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694737+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:44:18.694737+0000","last_peered":"2024-09-21T00:44:18.694737+0000","last_clean":"2024-09-21T00:44:18.694737+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:44:18.694737+0000","last_undegraded":"2024-09-21T00:44:18.694737+0000","last_fullsized":"2024-09-21T00:44:18.694737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.696528+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:18.696528+0000","last_peered":"2024-09-21T00:44:18.696528+0000","last_clean":"2024-09-21T00:44:18.696528+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:18.696528+0000","last_undegraded":"2024-09-21T00:44:18.696528+0000","last_fullsized":"2024-09-21T00:44:18.696528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691366+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:44:18.691366+0000","last_peered":"2024-09-21T00:44:18.691366+0000","last_clean":"2024-09-21T00:44:18.691366+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:44:18.691366+0000","last_undegraded":"2024-09-21T00:44:18.691366+0000","last_fullsized":"2024-09-21T00:44:18.691366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":44,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:39.776782+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:44:39.776782+0000","last_peered":"2024-09-21T00:44:39.776782+0000","last_clean":"2024-09-21T00:44:39.776782+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:44:39.776782+0000","last_undegraded":"2024-09-21T00:44:39.776782+0000","last_fullsized":"2024-09-21T00:44:39.776782+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":52798,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":148,"num_read_kb":133,"num_write":231,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":158394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":383194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005078,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1019035,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168604,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":382733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364833,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":383111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561061,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":976020,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724587,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":382841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":975307,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":382311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":382275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":429568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":428957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":384180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":47346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":47957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":46939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:44:45.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:44:45.758 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:46.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:45 smithi016 ceph-mon[30947]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-21T00:44:46.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:45 smithi016 ceph-mon[30947]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:45 smithi123 ceph-mon[34853]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-21T00:44:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:45 smithi123 ceph-mon[34853]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 -- 172.21.15.16:0/1508946366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe034105320 msgr2=0x7fe03410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 --2- 172.21.15.16:0/1508946366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe034105320 0x7fe03410d870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c02a410 comp rx=0 tx=0).stop 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 -- 172.21.15.16:0/1508946366 shutdown_connections 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 --2- 172.21.15.16:0/1508946366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 0x7fe034110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 --2- 172.21.15.16:0/1508946366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe034105320 0x7fe03410d870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 --2- 172.21.15.16:0/1508946366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0341049d0 0x7fe034104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 -- 172.21.15.16:0/1508946366 >> 172.21.15.16:0/1508946366 conn(0x7fe034079740 msgr2=0x7fe034079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 -- 172.21.15.16:0/1508946366 shutdown_connections 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.263+0000 7fe038c61640 1 -- 172.21.15.16:0/1508946366 wait complete. 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.264+0000 7fe038c61640 1 Processor -- start 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.264+0000 7fe038c61640 1 -- start start 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe034105320 0x7fe03419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 0x7fe03419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe034113a90 con 0x7fe0341049d0 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe034113910 con 0x7fe034105320 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe038c61640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe034113c10 con 0x7fe03410de30 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36496/0 (socket says 172.21.15.16:36496) 2024-09-21T00:44:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 -- 172.21.15.16:0/1170902338 learned_addr learned my addr 172.21.15.16:0/1170902338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe032d9d640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 0x7fe03419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe029d9b640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe034105320 0x7fe03419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 -- 172.21.15.16:0/1170902338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 msgr2=0x7fe03419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 0x7fe03419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 -- 172.21.15.16:0/1170902338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe034105320 msgr2=0x7fe03419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe034105320 0x7fe03419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 -- 172.21.15.16:0/1170902338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0341a03f0 con 0x7fe0341049d0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.265+0000 7fe03259c640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe02400d950 tx=0x7fe02400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.266+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024017020 con 0x7fe0341049d0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.266+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0341a06e0 con 0x7fe0341049d0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.266+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe024009c30 con 0x7fe0341049d0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.266+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02400f6b0 con 0x7fe0341049d0 2024-09-21T00:44:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.266+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0341a6e40 con 0x7fe0341049d0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.267+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe034104de0 con 0x7fe0341049d0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.268+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe02401a020 con 0x7fe0341049d0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.269+0000 7fe02bfff640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 0x7fe0200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.269+0000 7fe029d9b640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 0x7fe0200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.269+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe0240e73a0 con 0x7fe0341049d0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.270+0000 7fe029d9b640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 0x7fe0200b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe01c006010 tx=0x7fe01c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.272+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe024009de0 con 0x7fe0341049d0 2024-09-21T00:44:46.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:45 smithi178 ceph-mon[34888]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-21T00:44:46.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:45 smithi178 ceph-mon[34888]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:46.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.458+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe034063800 con 0x7fe0200b65a0 2024-09-21T00:44:46.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.462+0000 7fe02bfff640 1 -- 172.21.15.16:0/1170902338 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258944 (secure 0 0 0) 0x7fe034063800 con 0x7fe0200b65a0 2024-09-21T00:44:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:46.466 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 msgr2=0x7fe0200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 0x7fe0200b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe01c006010 tx=0x7fe01c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 msgr2=0x7fe03419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe02400d950 tx=0x7fe02400de10 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 shutdown_connections 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe0200b65a0 0x7fe0200b8ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03410de30 0x7fe03419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe034105320 0x7fe03419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 --2- 172.21.15.16:0/1170902338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0341049d0 0x7fe03419a480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.465+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 >> 172.21.15.16:0/1170902338 conn(0x7fe034079740 msgr2=0x7fe034100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.466+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 shutdown_connections 2024-09-21T00:44:46.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:46.466+0000 7fe038c61640 1 -- 172.21.15.16:0/1170902338 wait complete. 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]} : dispatch 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T00:44:47.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:46 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-21T00:44:46.260659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643400,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":244,"num_read_kb":207,"num_write":364,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379960,"kb_used_data":9912,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561864,"statfs":{"total":1151940427776,"available":1151551348736,"internally_reserved":0,"allocated":10149888,"data_stored":6536140,"data_compressed":112656,"data_compressed_allocated":143360,"data_compressed_original":1785856,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45195,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":108,"num_write":43,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002922"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694630+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:44:18.694630+0000","last_peered":"2024-09-21T00:44:18.694630+0000","last_clean":"2024-09-21T00:44:18.694630+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:44:18.694630+0000","last_undegraded":"2024-09-21T00:44:18.694630+0000","last_fullsized":"2024-09-21T00:44:18.694630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694770+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:44:18.694770+0000","last_peered":"2024-09-21T00:44:18.694770+0000","last_clean":"2024-09-21T00:44:18.694770+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:44:18.694770+0000","last_undegraded":"2024-09-21T00:44:18.694770+0000","last_fullsized":"2024-09-21T00:44:18.694770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694497+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:44:18.694497+0000","last_peered":"2024-09-21T00:44:18.694497+0000","last_clean":"2024-09-21T00:44:18.694497+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:44:18.694497+0000","last_undegraded":"2024-09-21T00:44:18.694497+0000","last_fullsized":"2024-09-21T00:44:18.694497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690204+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:44:18.690204+0000","last_peered":"2024-09-21T00:44:18.690204+0000","last_clean":"2024-09-21T00:44:18.690204+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:44:18.690204+0000","last_undegraded":"2024-09-21T00:44:18.690204+0000","last_fullsized":"2024-09-21T00:44:18.690204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689636+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:44:18.689636+0000","last_peered":"2024-09-21T00:44:18.689636+0000","last_clean":"2024-09-21T00:44:18.689636+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:44:18.689636+0000","last_undegraded":"2024-09-21T00:44:18.689636+0000","last_fullsized":"2024-09-21T00:44:18.689636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689713+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:44:18.689713+0000","last_peered":"2024-09-21T00:44:18.689713+0000","last_clean":"2024-09-21T00:44:18.689713+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:44:18.689713+0000","last_undegraded":"2024-09-21T00:44:18.689713+0000","last_fullsized":"2024-09-21T00:44:18.689713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694630+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:44:18.694630+0000","last_peered":"2024-09-21T00:44:18.694630+0000","last_clean":"2024-09-21T00:44:18.694630+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:44:18.694630+0000","last_undegraded":"2024-09-21T00:44:18.694630+0000","last_fullsized":"2024-09-21T00:44:18.694630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690649+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:44:18.690649+0000","last_peered":"2024-09-21T00:44:18.690649+0000","last_clean":"2024-09-21T00:44:18.690649+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:44:18.690649+0000","last_undegraded":"2024-09-21T00:44:18.690649+0000","last_fullsized":"2024-09-21T00:44:18.690649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673794+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:44:18.673794+0000","last_peered":"2024-09-21T00:44:18.673794+0000","last_clean":"2024-09-21T00:44:18.673794+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:44:18.673794+0000","last_undegraded":"2024-09-21T00:44:18.673794+0000","last_fullsized":"2024-09-21T00:44:18.673794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690822+0000","last_change":"2024-09-21T00:44:17.688705+0000","last_active":"2024-09-21T00:44:18.690822+0000","last_peered":"2024-09-21T00:44:18.690822+0000","last_clean":"2024-09-21T00:44:18.690822+0000","last_became_active":"2024-09-21T00:44:17.688342+0000","last_became_peered":"2024-09-21T00:44:17.688342+0000","last_unstale":"2024-09-21T00:44:18.690822+0000","last_undegraded":"2024-09-21T00:44:18.690822+0000","last_fullsized":"2024-09-21T00:44:18.690822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:58.758321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693944+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:44:18.693944+0000","last_peered":"2024-09-21T00:44:18.693944+0000","last_clean":"2024-09-21T00:44:18.693944+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:44:18.693944+0000","last_undegraded":"2024-09-21T00:44:18.693944+0000","last_fullsized":"2024-09-21T00:44:18.693944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690422+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:44:18.690422+0000","last_peered":"2024-09-21T00:44:18.690422+0000","last_clean":"2024-09-21T00:44:18.690422+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:44:18.690422+0000","last_undegraded":"2024-09-21T00:44:18.690422+0000","last_fullsized":"2024-09-21T00:44:18.690422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669118+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:44:18.669118+0000","last_peered":"2024-09-21T00:44:18.669118+0000","last_clean":"2024-09-21T00:44:18.669118+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:44:18.669118+0000","last_undegraded":"2024-09-21T00:44:18.669118+0000","last_fullsized":"2024-09-21T00:44:18.669118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694591+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:44:18.694591+0000","last_peered":"2024-09-21T00:44:18.694591+0000","last_clean":"2024-09-21T00:44:18.694591+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:44:18.694591+0000","last_undegraded":"2024-09-21T00:44:18.694591+0000","last_fullsized":"2024-09-21T00:44:18.694591+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694488+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:44:18.694488+0000","last_peered":"2024-09-21T00:44:18.694488+0000","last_clean":"2024-09-21T00:44:18.694488+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:44:18.694488+0000","last_undegraded":"2024-09-21T00:44:18.694488+0000","last_fullsized":"2024-09-21T00:44:18.694488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673155+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:44:18.673155+0000","last_peered":"2024-09-21T00:44:18.673155+0000","last_clean":"2024-09-21T00:44:18.673155+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:44:18.673155+0000","last_undegraded":"2024-09-21T00:44:18.673155+0000","last_fullsized":"2024-09-21T00:44:18.673155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694724+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:44:18.694724+0000","last_peered":"2024-09-21T00:44:18.694724+0000","last_clean":"2024-09-21T00:44:18.694724+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:44:18.694724+0000","last_undegraded":"2024-09-21T00:44:18.694724+0000","last_fullsized":"2024-09-21T00:44:18.694724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689437+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:44:18.689437+0000","last_peered":"2024-09-21T00:44:18.689437+0000","last_clean":"2024-09-21T00:44:18.689437+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:44:18.689437+0000","last_undegraded":"2024-09-21T00:44:18.689437+0000","last_fullsized":"2024-09-21T00:44:18.689437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669724+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:44:18.669724+0000","last_peered":"2024-09-21T00:44:18.669724+0000","last_clean":"2024-09-21T00:44:18.669724+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:44:18.669724+0000","last_undegraded":"2024-09-21T00:44:18.669724+0000","last_fullsized":"2024-09-21T00:44:18.669724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693827+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:44:18.693827+0000","last_peered":"2024-09-21T00:44:18.693827+0000","last_clean":"2024-09-21T00:44:18.693827+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:44:18.693827+0000","last_undegraded":"2024-09-21T00:44:18.693827+0000","last_fullsized":"2024-09-21T00:44:18.693827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669344+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:44:18.669344+0000","last_peered":"2024-09-21T00:44:18.669344+0000","last_clean":"2024-09-21T00:44:18.669344+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:44:18.669344+0000","last_undegraded":"2024-09-21T00:44:18.669344+0000","last_fullsized":"2024-09-21T00:44:18.669344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673506+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:44:18.673506+0000","last_peered":"2024-09-21T00:44:18.673506+0000","last_clean":"2024-09-21T00:44:18.673506+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:44:18.673506+0000","last_undegraded":"2024-09-21T00:44:18.673506+0000","last_fullsized":"2024-09-21T00:44:18.673506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690202+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:44:18.690202+0000","last_peered":"2024-09-21T00:44:18.690202+0000","last_clean":"2024-09-21T00:44:18.690202+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:44:18.690202+0000","last_undegraded":"2024-09-21T00:44:18.690202+0000","last_fullsized":"2024-09-21T00:44:18.690202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689996+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:44:18.689996+0000","last_peered":"2024-09-21T00:44:18.689996+0000","last_clean":"2024-09-21T00:44:18.689996+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:44:18.689996+0000","last_undegraded":"2024-09-21T00:44:18.689996+0000","last_fullsized":"2024-09-21T00:44:18.689996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691828+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:44:18.691828+0000","last_peered":"2024-09-21T00:44:18.691828+0000","last_clean":"2024-09-21T00:44:18.691828+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:44:18.691828+0000","last_undegraded":"2024-09-21T00:44:18.691828+0000","last_fullsized":"2024-09-21T00:44:18.691828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669983+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:44:18.669983+0000","last_peered":"2024-09-21T00:44:18.669983+0000","last_clean":"2024-09-21T00:44:18.669983+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:44:18.669983+0000","last_undegraded":"2024-09-21T00:44:18.669983+0000","last_fullsized":"2024-09-21T00:44:18.669983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694197+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:44:18.694197+0000","last_peered":"2024-09-21T00:44:18.694197+0000","last_clean":"2024-09-21T00:44:18.694197+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:44:18.694197+0000","last_undegraded":"2024-09-21T00:44:18.694197+0000","last_fullsized":"2024-09-21T00:44:18.694197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668907+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:44:18.668907+0000","last_peered":"2024-09-21T00:44:18.668907+0000","last_clean":"2024-09-21T00:44:18.668907+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:44:18.668907+0000","last_undegraded":"2024-09-21T00:44:18.668907+0000","last_fullsized":"2024-09-21T00:44:18.668907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694719+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:44:18.694719+0000","last_peered":"2024-09-21T00:44:18.694719+0000","last_clean":"2024-09-21T00:44:18.694719+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:44:18.694719+0000","last_undegraded":"2024-09-21T00:44:18.694719+0000","last_fullsized":"2024-09-21T00:44:18.694719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669910+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:44:18.669910+0000","last_peered":"2024-09-21T00:44:18.669910+0000","last_clean":"2024-09-21T00:44:18.669910+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:44:18.669910+0000","last_undegraded":"2024-09-21T00:44:18.669910+0000","last_fullsized":"2024-09-21T00:44:18.669910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.669670+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:44:18.669670+0000","last_peered":"2024-09-21T00:44:18.669670+0000","last_clean":"2024-09-21T00:44:18.669670+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:44:18.669670+0000","last_undegraded":"2024-09-21T00:44:18.669670+0000","last_fullsized":"2024-09-21T00:44:18.669670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693909+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:44:18.693909+0000","last_peered":"2024-09-21T00:44:18.693909+0000","last_clean":"2024-09-21T00:44:18.693909+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:44:18.693909+0000","last_undegraded":"2024-09-21T00:44:18.693909+0000","last_fullsized":"2024-09-21T00:44:18.693909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689407+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:44:18.689407+0000","last_peered":"2024-09-21T00:44:18.689407+0000","last_clean":"2024-09-21T00:44:18.689407+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:44:18.689407+0000","last_undegraded":"2024-09-21T00:44:18.689407+0000","last_fullsized":"2024-09-21T00:44:18.689407+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:41.781022+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:44:41.781022+0000","last_peered":"2024-09-21T00:44:41.781022+0000","last_clean":"2024-09-21T00:44:41.781022+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:44:41.781022+0000","last_undegraded":"2024-09-21T00:44:41.781022+0000","last_fullsized":"2024-09-21T00:44:41.781022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690456+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:44:18.690456+0000","last_peered":"2024-09-21T00:44:18.690456+0000","last_clean":"2024-09-21T00:44:18.690456+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:44:18.690456+0000","last_undegraded":"2024-09-21T00:44:18.690456+0000","last_fullsized":"2024-09-21T00:44:18.690456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.747658+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:28.747658+0000","last_peered":"2024-09-21T00:44:28.747658+0000","last_clean":"2024-09-21T00:44:28.747658+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:28.747658+0000","last_undegraded":"2024-09-21T00:44:28.747658+0000","last_fullsized":"2024-09-21T00:44:28.747658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:27.740726+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:27.740726+0000","last_peered":"2024-09-21T00:44:27.740726+0000","last_clean":"2024-09-21T00:44:27.740726+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:27.740726+0000","last_undegraded":"2024-09-21T00:44:27.740726+0000","last_fullsized":"2024-09-21T00:44:27.740726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690476+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:44:18.690476+0000","last_peered":"2024-09-21T00:44:18.690476+0000","last_clean":"2024-09-21T00:44:18.690476+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:44:18.690476+0000","last_undegraded":"2024-09-21T00:44:18.690476+0000","last_fullsized":"2024-09-21T00:44:18.690476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753590+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:29.753590+0000","last_peered":"2024-09-21T00:44:29.753590+0000","last_clean":"2024-09-21T00:44:29.753590+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:29.753590+0000","last_undegraded":"2024-09-21T00:44:29.753590+0000","last_fullsized":"2024-09-21T00:44:29.753590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689482+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:44:18.689482+0000","last_peered":"2024-09-21T00:44:18.689482+0000","last_clean":"2024-09-21T00:44:18.689482+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:44:18.689482+0000","last_undegraded":"2024-09-21T00:44:18.689482+0000","last_fullsized":"2024-09-21T00:44:18.689482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.778745+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:44:40.778745+0000","last_peered":"2024-09-21T00:44:40.778745+0000","last_clean":"2024-09-21T00:44:40.778745+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:44:40.778745+0000","last_undegraded":"2024-09-21T00:44:40.778745+0000","last_fullsized":"2024-09-21T00:44:40.778745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673786+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:44:18.673786+0000","last_peered":"2024-09-21T00:44:18.673786+0000","last_clean":"2024-09-21T00:44:18.673786+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:44:18.673786+0000","last_undegraded":"2024-09-21T00:44:18.673786+0000","last_fullsized":"2024-09-21T00:44:18.673786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.752206+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:29.752206+0000","last_peered":"2024-09-21T00:44:29.752206+0000","last_clean":"2024-09-21T00:44:29.752206+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:29.752206+0000","last_undegraded":"2024-09-21T00:44:29.752206+0000","last_fullsized":"2024-09-21T00:44:29.752206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694791+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:44:18.694791+0000","last_peered":"2024-09-21T00:44:18.694791+0000","last_clean":"2024-09-21T00:44:18.694791+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:44:18.694791+0000","last_undegraded":"2024-09-21T00:44:18.694791+0000","last_fullsized":"2024-09-21T00:44:18.694791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.747886+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:28.747886+0000","last_peered":"2024-09-21T00:44:28.747886+0000","last_clean":"2024-09-21T00:44:28.747886+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:28.747886+0000","last_undegraded":"2024-09-21T00:44:28.747886+0000","last_fullsized":"2024-09-21T00:44:28.747886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673581+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:44:18.673581+0000","last_peered":"2024-09-21T00:44:18.673581+0000","last_clean":"2024-09-21T00:44:18.673581+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:44:18.673581+0000","last_undegraded":"2024-09-21T00:44:18.673581+0000","last_fullsized":"2024-09-21T00:44:18.673581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'23","reported_seq":69,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.780689+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:44:40.780689+0000","last_peered":"2024-09-21T00:44:40.780689+0000","last_clean":"2024-09-21T00:44:40.780689+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:44:40.780689+0000","last_undegraded":"2024-09-21T00:44:40.780689+0000","last_fullsized":"2024-09-21T00:44:40.780689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":57,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691549+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:44:18.691549+0000","last_peered":"2024-09-21T00:44:18.691549+0000","last_clean":"2024-09-21T00:44:18.691549+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:44:18.691549+0000","last_undegraded":"2024-09-21T00:44:18.691549+0000","last_fullsized":"2024-09-21T00:44:18.691549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.760526+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:30.760526+0000","last_peered":"2024-09-21T00:44:30.760526+0000","last_clean":"2024-09-21T00:44:30.760526+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:30.760526+0000","last_undegraded":"2024-09-21T00:44:30.760526+0000","last_fullsized":"2024-09-21T00:44:30.760526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668526+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:44:18.668526+0000","last_peered":"2024-09-21T00:44:18.668526+0000","last_clean":"2024-09-21T00:44:18.668526+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:44:18.668526+0000","last_undegraded":"2024-09-21T00:44:18.668526+0000","last_fullsized":"2024-09-21T00:44:18.668526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753110+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:29.753110+0000","last_peered":"2024-09-21T00:44:29.753110+0000","last_clean":"2024-09-21T00:44:29.753110+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:29.753110+0000","last_undegraded":"2024-09-21T00:44:29.753110+0000","last_fullsized":"2024-09-21T00:44:29.753110+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695405+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:44:18.695405+0000","last_peered":"2024-09-21T00:44:18.695405+0000","last_clean":"2024-09-21T00:44:18.695405+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:44:18.695405+0000","last_undegraded":"2024-09-21T00:44:18.695405+0000","last_fullsized":"2024-09-21T00:44:18.695405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:40.779597+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:44:40.779597+0000","last_peered":"2024-09-21T00:44:40.779597+0000","last_clean":"2024-09-21T00:44:40.779597+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:44:40.779597+0000","last_undegraded":"2024-09-21T00:44:40.779597+0000","last_fullsized":"2024-09-21T00:44:40.779597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693823+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:44:18.693823+0000","last_peered":"2024-09-21T00:44:18.693823+0000","last_clean":"2024-09-21T00:44:18.693823+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:44:18.693823+0000","last_undegraded":"2024-09-21T00:44:18.693823+0000","last_fullsized":"2024-09-21T00:44:18.693823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.754479+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:29.754479+0000","last_peered":"2024-09-21T00:44:29.754479+0000","last_clean":"2024-09-21T00:44:29.754479+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:29.754479+0000","last_undegraded":"2024-09-21T00:44:29.754479+0000","last_fullsized":"2024-09-21T00:44:29.754479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689717+0000","last_change":"2024-09-21T00:44:17.683527+0000","last_active":"2024-09-21T00:44:18.689717+0000","last_peered":"2024-09-21T00:44:18.689717+0000","last_clean":"2024-09-21T00:44:18.689717+0000","last_became_active":"2024-09-21T00:44:17.682930+0000","last_became_peered":"2024-09-21T00:44:17.682930+0000","last_unstale":"2024-09-21T00:44:18.689717+0000","last_undegraded":"2024-09-21T00:44:18.689717+0000","last_fullsized":"2024-09-21T00:44:18.689717+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:46.139553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.735271+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:28.735271+0000","last_peered":"2024-09-21T00:44:28.735271+0000","last_clean":"2024-09-21T00:44:28.735271+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:28.735271+0000","last_undegraded":"2024-09-21T00:44:28.735271+0000","last_fullsized":"2024-09-21T00:44:28.735271+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693644+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:44:18.693644+0000","last_peered":"2024-09-21T00:44:18.693644+0000","last_clean":"2024-09-21T00:44:18.693644+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:44:18.693644+0000","last_undegraded":"2024-09-21T00:44:18.693644+0000","last_fullsized":"2024-09-21T00:44:18.693644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.750825+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:29.750825+0000","last_peered":"2024-09-21T00:44:29.750825+0000","last_clean":"2024-09-21T00:44:29.750825+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:29.750825+0000","last_undegraded":"2024-09-21T00:44:29.750825+0000","last_fullsized":"2024-09-21T00:44:29.750825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695027+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:44:18.695027+0000","last_peered":"2024-09-21T00:44:18.695027+0000","last_clean":"2024-09-21T00:44:18.695027+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:44:18.695027+0000","last_undegraded":"2024-09-21T00:44:18.695027+0000","last_fullsized":"2024-09-21T00:44:18.695027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753267+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:29.753267+0000","last_peered":"2024-09-21T00:44:29.753267+0000","last_clean":"2024-09-21T00:44:29.753267+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:29.753267+0000","last_undegraded":"2024-09-21T00:44:29.753267+0000","last_fullsized":"2024-09-21T00:44:29.753267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:19.306526+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:44:19.306526+0000","last_peered":"2024-09-21T00:44:19.306526+0000","last_clean":"2024-09-21T00:44:19.306526+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:44:19.306526+0000","last_undegraded":"2024-09-21T00:44:19.306526+0000","last_fullsized":"2024-09-21T00:44:19.306526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":44,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:44.785713+0000","last_change":"2024-09-21T00:44:16.130811+0000","last_active":"2024-09-21T00:44:44.785713+0000","last_peered":"2024-09-21T00:44:44.785713+0000","last_clean":"2024-09-21T00:44:44.785713+0000","last_became_active":"2024-09-21T00:44:16.130251+0000","last_became_peered":"2024-09-21T00:44:16.130251+0000","last_unstale":"2024-09-21T00:44:44.785713+0000","last_undegraded":"2024-09-21T00:44:44.785713+0000","last_fullsized":"2024-09-21T00:44:44.785713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:04:29.311797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694186+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:44:18.694186+0000","last_peered":"2024-09-21T00:44:18.694186+0000","last_clean":"2024-09-21T00:44:18.694186+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:44:18.694186+0000","last_undegraded":"2024-09-21T00:44:18.694186+0000","last_fullsized":"2024-09-21T00:44:18.694186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":94,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694264+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:18.694264+0000","last_peered":"2024-09-21T00:44:18.694264+0000","last_clean":"2024-09-21T00:44:18.694264+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:18.694264+0000","last_undegraded":"2024-09-21T00:44:18.694264+0000","last_fullsized":"2024-09-21T00:44:18.694264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.760276+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:30.760276+0000","last_peered":"2024-09-21T00:44:30.760276+0000","last_clean":"2024-09-21T00:44:30.760276+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:30.760276+0000","last_undegraded":"2024-09-21T00:44:30.760276+0000","last_fullsized":"2024-09-21T00:44:30.760276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690366+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:44:18.690366+0000","last_peered":"2024-09-21T00:44:18.690366+0000","last_clean":"2024-09-21T00:44:18.690366+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:44:18.690366+0000","last_undegraded":"2024-09-21T00:44:18.690366+0000","last_fullsized":"2024-09-21T00:44:18.690366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:27.741329+0000","last_change":"2024-09-21T00:44:15.660111+0000","last_active":"2024-09-21T00:44:27.741329+0000","last_peered":"2024-09-21T00:44:27.741329+0000","last_clean":"2024-09-21T00:44:27.741329+0000","last_became_active":"2024-09-21T00:44:15.659689+0000","last_became_peered":"2024-09-21T00:44:15.659689+0000","last_unstale":"2024-09-21T00:44:27.741329+0000","last_undegraded":"2024-09-21T00:44:27.741329+0000","last_fullsized":"2024-09-21T00:44:27.741329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:04.887245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668539+0000","last_change":"2024-09-21T00:44:17.679905+0000","last_active":"2024-09-21T00:44:18.668539+0000","last_peered":"2024-09-21T00:44:18.668539+0000","last_clean":"2024-09-21T00:44:18.668539+0000","last_became_active":"2024-09-21T00:44:17.679512+0000","last_became_peered":"2024-09-21T00:44:17.679512+0000","last_unstale":"2024-09-21T00:44:18.668539+0000","last_undegraded":"2024-09-21T00:44:18.668539+0000","last_fullsized":"2024-09-21T00:44:18.668539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:35.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:43.783166+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:44:43.783166+0000","last_peered":"2024-09-21T00:44:43.783166+0000","last_clean":"2024-09-21T00:44:43.783166+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:44:43.783166+0000","last_undegraded":"2024-09-21T00:44:43.783166+0000","last_fullsized":"2024-09-21T00:44:43.783166+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.690233+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:44:18.690233+0000","last_peered":"2024-09-21T00:44:18.690233+0000","last_clean":"2024-09-21T00:44:18.690233+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:44:18.690233+0000","last_undegraded":"2024-09-21T00:44:18.690233+0000","last_fullsized":"2024-09-21T00:44:18.690233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:42.781765+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:44:42.781765+0000","last_peered":"2024-09-21T00:44:42.781765+0000","last_clean":"2024-09-21T00:44:42.781765+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:44:42.781765+0000","last_undegraded":"2024-09-21T00:44:42.781765+0000","last_fullsized":"2024-09-21T00:44:42.781765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689930+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:44:18.689930+0000","last_peered":"2024-09-21T00:44:18.689930+0000","last_clean":"2024-09-21T00:44:18.689930+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:44:18.689930+0000","last_undegraded":"2024-09-21T00:44:18.689930+0000","last_fullsized":"2024-09-21T00:44:18.689930+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689116+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:18.689116+0000","last_peered":"2024-09-21T00:44:18.689116+0000","last_clean":"2024-09-21T00:44:18.689116+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:18.689116+0000","last_undegraded":"2024-09-21T00:44:18.689116+0000","last_fullsized":"2024-09-21T00:44:18.689116+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:21.569555+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:44:21.569555+0000","last_peered":"2024-09-21T00:44:21.569555+0000","last_clean":"2024-09-21T00:44:21.569555+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:44:21.569555+0000","last_undegraded":"2024-09-21T00:44:21.569555+0000","last_fullsized":"2024-09-21T00:44:21.569555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.754432+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:29.754432+0000","last_peered":"2024-09-21T00:44:29.754432+0000","last_clean":"2024-09-21T00:44:29.754432+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:29.754432+0000","last_undegraded":"2024-09-21T00:44:29.754432+0000","last_fullsized":"2024-09-21T00:44:29.754432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.668888+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:44:18.668888+0000","last_peered":"2024-09-21T00:44:18.668888+0000","last_clean":"2024-09-21T00:44:18.668888+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:44:18.668888+0000","last_undegraded":"2024-09-21T00:44:18.668888+0000","last_fullsized":"2024-09-21T00:44:18.668888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'16","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:43.689567+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:44:43.689567+0000","last_peered":"2024-09-21T00:44:43.689567+0000","last_clean":"2024-09-21T00:44:43.689567+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:44:43.689567+0000","last_undegraded":"2024-09-21T00:44:43.689567+0000","last_fullsized":"2024-09-21T00:44:43.689567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691629+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:44:18.691629+0000","last_peered":"2024-09-21T00:44:18.691629+0000","last_clean":"2024-09-21T00:44:18.691629+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:44:18.691629+0000","last_undegraded":"2024-09-21T00:44:18.691629+0000","last_fullsized":"2024-09-21T00:44:18.691629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753143+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:29.753143+0000","last_peered":"2024-09-21T00:44:29.753143+0000","last_clean":"2024-09-21T00:44:29.753143+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:29.753143+0000","last_undegraded":"2024-09-21T00:44:29.753143+0000","last_fullsized":"2024-09-21T00:44:29.753143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694928+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:44:18.694928+0000","last_peered":"2024-09-21T00:44:18.694928+0000","last_clean":"2024-09-21T00:44:18.694928+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:44:18.694928+0000","last_undegraded":"2024-09-21T00:44:18.694928+0000","last_fullsized":"2024-09-21T00:44:18.694928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:26.735137+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:26.735137+0000","last_peered":"2024-09-21T00:44:26.735137+0000","last_clean":"2024-09-21T00:44:26.735137+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:26.735137+0000","last_undegraded":"2024-09-21T00:44:26.735137+0000","last_fullsized":"2024-09-21T00:44:26.735137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.689258+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:44:18.689258+0000","last_peered":"2024-09-21T00:44:18.689258+0000","last_clean":"2024-09-21T00:44:18.689258+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:44:18.689258+0000","last_undegraded":"2024-09-21T00:44:18.689258+0000","last_fullsized":"2024-09-21T00:44:18.689258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.750844+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:29.750844+0000","last_peered":"2024-09-21T00:44:29.750844+0000","last_clean":"2024-09-21T00:44:29.750844+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:29.750844+0000","last_undegraded":"2024-09-21T00:44:29.750844+0000","last_fullsized":"2024-09-21T00:44:29.750844+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.693700+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:44:18.693700+0000","last_peered":"2024-09-21T00:44:18.693700+0000","last_clean":"2024-09-21T00:44:18.693700+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:44:18.693700+0000","last_undegraded":"2024-09-21T00:44:18.693700+0000","last_fullsized":"2024-09-21T00:44:18.693700+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:28.749230+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:28.749230+0000","last_peered":"2024-09-21T00:44:28.749230+0000","last_clean":"2024-09-21T00:44:28.749230+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:28.749230+0000","last_undegraded":"2024-09-21T00:44:28.749230+0000","last_fullsized":"2024-09-21T00:44:28.749230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691095+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:44:18.691095+0000","last_peered":"2024-09-21T00:44:18.691095+0000","last_clean":"2024-09-21T00:44:18.691095+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:44:18.691095+0000","last_undegraded":"2024-09-21T00:44:18.691095+0000","last_fullsized":"2024-09-21T00:44:18.691095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:26.734976+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:26.734976+0000","last_peered":"2024-09-21T00:44:26.734976+0000","last_clean":"2024-09-21T00:44:26.734976+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:26.734976+0000","last_undegraded":"2024-09-21T00:44:26.734976+0000","last_fullsized":"2024-09-21T00:44:26.734976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.695061+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:44:18.695061+0000","last_peered":"2024-09-21T00:44:18.695061+0000","last_clean":"2024-09-21T00:44:18.695061+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:44:18.695061+0000","last_undegraded":"2024-09-21T00:44:18.695061+0000","last_fullsized":"2024-09-21T00:44:18.695061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.696978+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:44:18.696978+0000","last_peered":"2024-09-21T00:44:18.696978+0000","last_clean":"2024-09-21T00:44:18.696978+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:44:18.696978+0000","last_undegraded":"2024-09-21T00:44:18.696978+0000","last_fullsized":"2024-09-21T00:44:18.696978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:29.753150+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:29.753150+0000","last_peered":"2024-09-21T00:44:29.753150+0000","last_clean":"2024-09-21T00:44:29.753150+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:29.753150+0000","last_undegraded":"2024-09-21T00:44:29.753150+0000","last_fullsized":"2024-09-21T00:44:29.753150+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.673220+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:44:18.673220+0000","last_peered":"2024-09-21T00:44:18.673220+0000","last_clean":"2024-09-21T00:44:18.673220+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:44:18.673220+0000","last_undegraded":"2024-09-21T00:44:18.673220+0000","last_fullsized":"2024-09-21T00:44:18.673220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:30.762081+0000","last_change":"2024-09-21T00:44:15.662976+0000","last_active":"2024-09-21T00:44:30.762081+0000","last_peered":"2024-09-21T00:44:30.762081+0000","last_clean":"2024-09-21T00:44:30.762081+0000","last_became_active":"2024-09-21T00:44:15.662506+0000","last_became_peered":"2024-09-21T00:44:15.662506+0000","last_unstale":"2024-09-21T00:44:30.762081+0000","last_undegraded":"2024-09-21T00:44:30.762081+0000","last_fullsized":"2024-09-21T00:44:30.762081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:18.920553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.694737+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:44:18.694737+0000","last_peered":"2024-09-21T00:44:18.694737+0000","last_clean":"2024-09-21T00:44:18.694737+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:44:18.694737+0000","last_undegraded":"2024-09-21T00:44:18.694737+0000","last_fullsized":"2024-09-21T00:44:18.694737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.696528+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:18.696528+0000","last_peered":"2024-09-21T00:44:18.696528+0000","last_clean":"2024-09-21T00:44:18.696528+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:18.696528+0000","last_undegraded":"2024-09-21T00:44:18.696528+0000","last_fullsized":"2024-09-21T00:44:18.696528+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:18.691366+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:44:18.691366+0000","last_peered":"2024-09-21T00:44:18.691366+0000","last_clean":"2024-09-21T00:44:18.691366+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:44:18.691366+0000","last_undegraded":"2024-09-21T00:44:18.691366+0000","last_fullsized":"2024-09-21T00:44:18.691366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":49,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T00:44:44.784129+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:44:44.784129+0000","last_peered":"2024-09-21T00:44:44.784129+0000","last_clean":"2024-09-21T00:44:44.784129+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:44:44.784129+0000","last_undegraded":"2024-09-21T00:44:44.784129+0000","last_fullsized":"2024-09-21T00:44:44.784129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":52798,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":168,"num_read_kb":143,"num_write":239,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":185002,"data_compressed":3678,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":383194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005078,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1019035,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168605,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":382733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364834,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":383111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561062,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":976020,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":382841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920816,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":975307,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":382311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":382275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444097,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":442872,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":442261,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":384180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60650,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61261,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":46939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:44:47.244 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:44:47.245 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T00:44:47.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]} : dispatch 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T00:44:47.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:46 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T00:44:47.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:46 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T00:44:47.501 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T00:44:47.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:47 smithi016 ceph-mon[30947]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:44:47.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 -- 172.21.15.16:0/2176813572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 msgr2=0x7f9c341087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 --2- 172.21.15.16:0/2176813572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c341087e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c3002a410 comp rx=0 tx=0).stop 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 -- 172.21.15.16:0/2176813572 shutdown_connections 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 --2- 172.21.15.16:0/2176813572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3410dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 --2- 172.21.15.16:0/2176813572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 0x7f9c3410b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 --2- 172.21.15.16:0/2176813572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c341087e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.991+0000 7f9c3c035640 1 -- 172.21.15.16:0/2176813572 >> 172.21.15.16:0/2176813572 conn(0x7f9c340fe020 msgr2=0x7f9c341004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.992+0000 7f9c3c035640 1 -- 172.21.15.16:0/2176813572 shutdown_connections 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.992+0000 7f9c3c035640 1 -- 172.21.15.16:0/2176813572 wait complete. 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.992+0000 7f9c3c035640 1 Processor -- start 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.992+0000 7f9c3c035640 1 -- start start 2024-09-21T00:44:47.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.992+0000 7f9c3c035640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 0x7f9c3419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341115d0 con 0x7f9c3406c410 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34111450 con 0x7f9c34108d20 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34111750 con 0x7f9c3410b6d0 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36514/0 (socket says 172.21.15.16:36514) 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 -- 172.21.15.16:0/3323733220 learned_addr learned my addr 172.21.15.16:0/3323733220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c395d0640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 0x7f9c3419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3a5d2640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 -- 172.21.15.16:0/3323733220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 msgr2=0x7f9c3419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:47.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 -- 172.21.15.16:0/3323733220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 msgr2=0x7f9c3419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 0x7f9c3419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 -- 172.21.15.16:0/3323733220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3419dc10 con 0x7f9c3406c410 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3a5d2640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c39dd1640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c30006010 tx=0x7f9c30004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3003f030 con 0x7f9c3406c410 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c30003cb0 con 0x7f9c3406c410 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3419dea0 con 0x7f9c3406c410 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.993+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30035070 con 0x7f9c3406c410 2024-09-21T00:44:47.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.994+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c341a4430 con 0x7f9c3406c410 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.995+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c340ffb40 con 0x7f9c3406c410 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.996+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9c30042030 con 0x7f9c3406c410 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.997+0000 7f9c2affd640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 0x7f9c200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.997+0000 7f9c395d0640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 0x7f9c200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.997+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f9c30108300 con 0x7f9c3406c410 2024-09-21T00:44:47.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:47.997+0000 7f9c395d0640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 0x7f9c200b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c240058c0 tx=0x7f9c2400a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:48.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.000+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c300cea20 con 0x7f9c3406c410 2024-09-21T00:44:48.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.260+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f9c3402e640 con 0x7f9c3406c410 2024-09-21T00:44:48.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.263+0000 7f9c2affd640 1 -- 172.21.15.16:0/3323733220 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f9c30003e60 con 0x7f9c3406c410 2024-09-21T00:44:48.264 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-09-21T00:44:48.264 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAAF+5mSmmcDxAAc1mTtsQVA39VpZZx+7n2JA== 2024-09-21T00:44:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 msgr2=0x7f9c200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 0x7f9c200b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c240058c0 tx=0x7f9c2400a4c0 comp rx=0 tx=0).stop 2024-09-21T00:44:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 msgr2=0x7f9c3419c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c30006010 tx=0x7f9c30004340 comp rx=0 tx=0).stop 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 shutdown_connections 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9c200b65a0 0x7f9c200b8ab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3410b6d0 0x7f9c3419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c34108d20 0x7f9c3419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 --2- 172.21.15.16:0/3323733220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c3406c410 0x7f9c3419c250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 >> 172.21.15.16:0/3323733220 conn(0x7f9c340fe020 msgr2=0x7f9c34109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 shutdown_connections 2024-09-21T00:44:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:48.266+0000 7f9c3c035640 1 -- 172.21.15.16:0/3323733220 wait complete. 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T00:44:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:47 smithi123 ceph-mon[34853]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T00:44:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:47 smithi178 ceph-mon[34888]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:44:49.005 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:48 smithi016 ceph-mon[30947]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:44:49.005 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:48 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:44:49.005 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:48 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:44:49.038 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:44:49.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T00:44:49.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T00:44:49.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T00:44:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:48 smithi123 ceph-mon[34853]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:44:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:48 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:44:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:48 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:44:49.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:48 smithi178 ceph-mon[34888]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:44:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:48 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:44:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:48 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3323733220' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:44:49.380 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:49.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:49 smithi016 ceph-mon[30947]: pgmap v306: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 -- 172.21.15.16:0/938361626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3050108d10 msgr2=0x7f305010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 --2- 172.21.15.16:0/938361626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3050108d10 0x7f305010f540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3048009ca0 tx=0x7f304802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 -- 172.21.15.16:0/938361626 shutdown_connections 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 --2- 172.21.15.16:0/938361626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3050108d10 0x7f305010f540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 --2- 172.21.15.16:0/938361626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30501083c0 0x7f30501087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 --2- 172.21.15.16:0/938361626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 0x7f3050102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.917+0000 7f3057643640 1 -- 172.21.15.16:0/938361626 >> 172.21.15.16:0/938361626 conn(0x7f3050079740 msgr2=0x7f3050079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.918+0000 7f3057643640 1 -- 172.21.15.16:0/938361626 shutdown_connections 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.918+0000 7f3057643640 1 -- 172.21.15.16:0/938361626 wait complete. 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.918+0000 7f3057643640 1 Processor -- start 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 -- start start 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 0x7f305019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 0x7f305019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f305006c670 con 0x7f30501083c0 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f305006c4f0 con 0x7f3050108d10 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3057643640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f305006c7f0 con 0x7f3050102a80 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36530/0 (socket says 172.21.15.16:36530) 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 -- 172.21.15.16:0/462897271 learned_addr learned my addr 172.21.15.16:0/462897271 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3055be0640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 0x7f305019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f30553df640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 0x7f305019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 -- 172.21.15.16:0/462897271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 msgr2=0x7f305019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 0x7f305019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 -- 172.21.15.16:0/462897271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 msgr2=0x7f305019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 0x7f305019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3054bde640 1 -- 172.21.15.16:0/462897271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30501a0430 con 0x7f30501083c0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.919+0000 7f3055be0640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 0x7f305019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f3054bde640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f304000c970 tx=0x7f304000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040007bb0 con 0x7f30501083c0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3040007d50 con 0x7f30501083c0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304000f450 con 0x7f30501083c0 2024-09-21T00:44:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30501a0720 con 0x7f30501083c0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.920+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30501a6e80 con 0x7f30501083c0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.921+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3050103d00 con 0x7f30501083c0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.923+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3040004f20 con 0x7f30501083c0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.923+0000 7f30467fc640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 0x7f303c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.924+0000 7f30553df640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 0x7f303c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.924+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f30400e7410 con 0x7f30501083c0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.924+0000 7f30553df640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 0x7f303c0b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f304c005fd0 tx=0x7f304c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:49.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:49.927+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3040014030 con 0x7f30501083c0 2024-09-21T00:44:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.119+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3050102e90 con 0x7f30501083c0 2024-09-21T00:44:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.119+0000 7f30467fc640 1 -- 172.21.15.16:0/462897271 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v52) ==== 86+0+133 (secure 0 0 0) 0x7f30400adc30 con 0x7f30501083c0 2024-09-21T00:44:50.120 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.121+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 msgr2=0x7f303c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.121+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 0x7f303c0b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f304c005fd0 tx=0x7f304c005e20 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.121+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 msgr2=0x7f305019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.121+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f304000c970 tx=0x7f304000ce30 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 shutdown_connections 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f303c0b65a0 0x7f303c0b8ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3050108d10 0x7f305019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30501083c0 0x7f305019aa60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 --2- 172.21.15.16:0/462897271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3050102a80 0x7f305019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 >> 172.21.15.16:0/462897271 conn(0x7f3050079740 msgr2=0x7f3050104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:50.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 shutdown_connections 2024-09-21T00:44:50.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:50.122+0000 7f3057643640 1 -- 172.21.15.16:0/462897271 wait complete. 2024-09-21T00:44:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:49 smithi123 ceph-mon[34853]: pgmap v306: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T00:44:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:49 smithi178 ceph-mon[34888]: pgmap v306: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-21T00:44:50.847 INFO:teuthology.orchestra.run.smithi016.stdout:[{"version":52,"timestamp":"2024-09-21T00:44:07.575560+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T00:44:50.847 INFO:tasks.ceph_manager:config epoch is 52 2024-09-21T00:44:50.848 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T00:44:50.848 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T00:44:50.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T00:44:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:51.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:50 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/462897271' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:44:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:50 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/462897271' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:44:51.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:50 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/462897271' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 -- 172.21.15.16:0/662328700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 msgr2=0x7feb0c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 --2- 172.21.15.16:0/662328700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c10d8d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feafc009900 tx=0x7feafc02a410 comp rx=0 tx=0).stop 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 -- 172.21.15.16:0/662328700 shutdown_connections 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 --2- 172.21.15.16:0/662328700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 --2- 172.21.15.16:0/662328700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c10d8d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 --2- 172.21.15.16:0/662328700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 0x7feb0c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 -- 172.21.15.16:0/662328700 >> 172.21.15.16:0/662328700 conn(0x7feb0c0797b0 msgr2=0x7feb0c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 -- 172.21.15.16:0/662328700 shutdown_connections 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.575+0000 7feb13007640 1 -- 172.21.15.16:0/662328700 wait complete. 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 Processor -- start 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 -- start start 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 0x7feb0c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c113b60 con 0x7feb0c105380 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c1139e0 con 0x7feb0c10de60 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb13007640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c113ce0 con 0x7feb0c104a30 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:51.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36558/0 (socket says 172.21.15.16:36558) 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb0bfff640 1 -- 172.21.15.16:0/1927052606 learned_addr learned my addr 172.21.15.16:0/1927052606 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb115a4640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb10da3640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 0x7feb0c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb0bfff640 1 -- 172.21.15.16:0/1927052606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 msgr2=0x7feb0c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.576+0000 7feb0bfff640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 0x7feb0c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb0bfff640 1 -- 172.21.15.16:0/1927052606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 msgr2=0x7feb0c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb0bfff640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb0bfff640 1 -- 172.21.15.16:0/1927052606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0c1a8890 con 0x7feb0c105380 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb115a4640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb0bfff640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feafc02a930 tx=0x7feafc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc03f030 con 0x7feb0c105380 2024-09-21T00:44:51.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feafc003cb0 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc035070 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0c1a8b20 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.577+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0c1a9050 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.578+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb0c104ec0 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.580+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7feafc042030 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.580+0000 7feb09ffb640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 0x7feaf80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.581+0000 7feb10da3640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 0x7feaf80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.581+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7feafc107f90 con 0x7feb0c105380 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.581+0000 7feb10da3640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 0x7feaf80b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb0c1041c0 tx=0x7feaf4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:51.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.584+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feafc0ce6b0 con 0x7feb0c105380 2024-09-21T00:44:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.822+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7feb0c02e640 con 0x7feb0c105380 2024-09-21T00:44:51.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.827+0000 7feb09ffb640 1 -- 172.21.15.16:0/1927052606 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) ==== 74+0+296437 (secure 0 0 0) 0x7feafc0d2a90 con 0x7feb0c105380 2024-09-21T00:44:51.831 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 msgr2=0x7feaf80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 0x7feaf80b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb0c1041c0 tx=0x7feaf4008040 comp rx=0 tx=0).stop 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 msgr2=0x7feb0c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feafc02a930 tx=0x7feafc004270 comp rx=0 tx=0).stop 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 shutdown_connections 2024-09-21T00:44:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feaf80b6620 0x7feaf80b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb0c10de60 0x7feb0c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c105380 0x7feb0c102cb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 --2- 172.21.15.16:0/1927052606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb0c104a30 0x7feb0c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 >> 172.21.15.16:0/1927052606 conn(0x7feb0c0797b0 msgr2=0x7feb0c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 shutdown_connections 2024-09-21T00:44:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:51.831+0000 7feb13007640 1 -- 172.21.15.16:0/1927052606 wait complete. 2024-09-21T00:44:52.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:51 smithi016 ceph-mon[30947]: pgmap v307: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T00:44:52.273 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:51 smithi123 ceph-mon[34853]: pgmap v307: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T00:44:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:51 smithi178 ceph-mon[34888]: pgmap v307: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T00:44:52.598 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":4223283672},{"type":"v1","addr":"172.21.15.16:6801","nonce":4223283672}]},"active_addr":"172.21.15.16:6801/4223283672","active_change":"2024-09-21T00:36:46.160651+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24124,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24137,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.16:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":4140210188}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":3858925140}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1704008738}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":239570127}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":3823511224}]}]} 2024-09-21T00:44:52.604 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T00:44:52.604 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T00:44:52.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:44:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:53.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:52 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1927052606' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:44:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:52 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1927052606' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:44:53.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:52 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1927052606' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- 172.21.15.16:0/183873911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378102670 msgr2=0x7f2378102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 --2- 172.21.15.16:0/183873911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378102670 0x7f2378102a80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2374009900 tx=0x7f237402a480 comp rx=0 tx=0).stop 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- 172.21.15.16:0/183873911 shutdown_connections 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 --2- 172.21.15.16:0/183873911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378110220 0x7f2378112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 --2- 172.21.15.16:0/183873911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 0x7f237810fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 --2- 172.21.15.16:0/183873911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378102670 0x7f2378102a80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- 172.21.15.16:0/183873911 >> 172.21.15.16:0/183873911 conn(0x7f2378079740 msgr2=0x7f2378079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- 172.21.15.16:0/183873911 shutdown_connections 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- 172.21.15.16:0/183873911 wait complete. 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 Processor -- start 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.376+0000 7f237fbac640 1 -- start start 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378102670 0x7f237819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 0x7f237819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2378115d30 con 0x7f2378110220 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2378115bb0 con 0x7f2378102fc0 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237fbac640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2378115eb0 con 0x7f2378102670 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36586/0 (socket says 172.21.15.16:36586) 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 -- 172.21.15.16:0/447455374 learned_addr learned my addr 172.21.15.16:0/447455374 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237d948640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378102670 0x7f237819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237d147640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 0x7f237819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 -- 172.21.15.16:0/447455374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378102670 msgr2=0x7f237819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378102670 0x7f237819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 -- 172.21.15.16:0/447455374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 msgr2=0x7f237819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 0x7f237819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 -- 172.21.15.16:0/447455374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23781a2750 con 0x7f2378110220 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.377+0000 7f237e149640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f237000b970 tx=0x7f237000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.378+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370019070 con 0x7f2378110220 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.378+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23781a2a40 con 0x7f2378110220 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.378+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370014440 con 0x7f2378110220 2024-09-21T00:44:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.378+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23700075d0 con 0x7f2378110220 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.378+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23781a91a0 con 0x7f2378110220 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.379+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237806c1c0 con 0x7f2378110220 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.380+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f237001c070 con 0x7f2378110220 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.381+0000 7f236effd640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 0x7f23640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.381+0000 7f237d948640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 0x7f23640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.381+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f23700e6d00 con 0x7f2378110220 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.382+0000 7f237d948640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 0x7f23640b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2374031440 tx=0x7f2374005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.384+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23700b1900 con 0x7f2378110220 2024-09-21T00:44:53.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.575+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2378102b00 con 0x7f2378110220 2024-09-21T00:44:53.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.576+0000 7f236effd640 1 -- 172.21.15.16:0/447455374 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f2378102b00 con 0x7f2378110220 2024-09-21T00:44:53.578 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:53.578 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 msgr2=0x7f23640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 0x7f23640b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2374031440 tx=0x7f2374005e80 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 msgr2=0x7f23781a2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f237000b970 tx=0x7f237000be30 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 shutdown_connections 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f23640b65a0 0x7f23640b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2378110220 0x7f23781a2020 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2378102fc0 0x7f237819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 --2- 172.21.15.16:0/447455374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2378102670 0x7f237819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 >> 172.21.15.16:0/447455374 conn(0x7f2378079740 msgr2=0x7f2378111730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:53.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 shutdown_connections 2024-09-21T00:44:53.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:53.579+0000 7f237fbac640 1 -- 172.21.15.16:0/447455374 wait complete. 2024-09-21T00:44:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:53 smithi016 ceph-mon[30947]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s; 195 B/s, 0 objects/s recovering 2024-09-21T00:44:54.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:53 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/447455374' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:53 smithi123 ceph-mon[34853]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s; 195 B/s, 0 objects/s recovering 2024-09-21T00:44:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:53 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/447455374' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:53 smithi178 ceph-mon[34888]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s; 195 B/s, 0 objects/s recovering 2024-09-21T00:44:54.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:53 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/447455374' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:54.398 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T00:44:54.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:44:54.661 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 -- 172.21.15.16:0/825235660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 msgr2=0x7fec34110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 --2- 172.21.15.16:0/825235660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec34110320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009ca0 tx=0x7fec2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 -- 172.21.15.16:0/825235660 shutdown_connections 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 --2- 172.21.15.16:0/825235660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec34110320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 --2- 172.21.15.16:0/825235660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341052d0 0x7fec3410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 --2- 172.21.15.16:0/825235660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341048a0 0x7fec34104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 -- 172.21.15.16:0/825235660 >> 172.21.15.16:0/825235660 conn(0x7fec34079740 msgr2=0x7fec34079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 -- 172.21.15.16:0/825235660 shutdown_connections 2024-09-21T00:44:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.162+0000 7fec3a52a640 1 -- 172.21.15.16:0/825235660 wait complete. 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.163+0000 7fec3a52a640 1 Processor -- start 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.163+0000 7fec3a52a640 1 -- start start 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341048a0 0x7fec3419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341052d0 0x7fec3419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec34113a90 con 0x7fec3410de50 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec34113910 con 0x7fec341052d0 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec3a52a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fec34113c10 con 0x7fec341048a0 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54942/0 (socket says 172.21.15.16:54942) 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 -- 172.21.15.16:0/536699650 learned_addr learned my addr 172.21.15.16:0/536699650 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec337fe640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341052d0 0x7fec3419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec33fff640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341048a0 0x7fec3419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 -- 172.21.15.16:0/536699650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341048a0 msgr2=0x7fec3419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341048a0 0x7fec3419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 -- 172.21.15.16:0/536699650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341052d0 msgr2=0x7fec3419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341052d0 0x7fec3419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 -- 172.21.15.16:0/536699650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec341a03d0 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec38ac7640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec2c005cc0 tx=0x7fec2c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.164+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c003bf0 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.165+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec341a0660 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.165+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec2c003d90 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.165+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c02fbc0 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.165+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec341a6e20 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.166+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3406c1a0 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.167+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fec2c02fd60 con 0x7fec3410de50 2024-09-21T00:44:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.168+0000 7fec317fa640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 0x7fec1c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.168+0000 7fec33fff640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 0x7fec1c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.168+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fec2c1089a0 con 0x7fec3410de50 2024-09-21T00:44:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.168+0000 7fec33fff640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 0x7fec1c0b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec3406c8a0 tx=0x7fec2400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.171+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec2c0cf1c0 con 0x7fec3410de50 2024-09-21T00:44:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.361+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec34104cb0 con 0x7fec3410de50 2024-09-21T00:44:55.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.362+0000 7fec317fa640 1 -- 172.21.15.16:0/536699650 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7fec2c0d35a0 con 0x7fec3410de50 2024-09-21T00:44:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:44:55.364 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 msgr2=0x7fec1c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 0x7fec1c0b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec3406c8a0 tx=0x7fec2400b390 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 msgr2=0x7fec3419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec2c005cc0 tx=0x7fec2c02f380 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 shutdown_connections 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fec1c0b65a0 0x7fec1c0b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec3410de50 0x7fec3419fca0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec341052d0 0x7fec3419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 --2- 172.21.15.16:0/536699650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec341048a0 0x7fec3419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 >> 172.21.15.16:0/536699650 conn(0x7fec34079740 msgr2=0x7fec34107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 shutdown_connections 2024-09-21T00:44:55.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:55.366+0000 7fec3a52a640 1 -- 172.21.15.16:0/536699650 wait complete. 2024-09-21T00:44:56.119 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:55 smithi016 ceph-mon[30947]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s; 195 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:56.119 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/536699650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:56.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T00:44:56.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T00:44:56.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T00:44:56.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T00:44:56.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T00:44:56.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T00:44:56.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T00:44:56.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T00:44:56.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T00:44:56.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T00:44:56.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T00:44:56.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T00:44:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:55 smithi123 ceph-mon[34853]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s; 195 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/536699650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:56.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:55 smithi178 ceph-mon[34888]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s; 195 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:56.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/536699650' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:44:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:56.852 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 -- 172.21.15.16:0/2820940936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90102a60 msgr2=0x7f1f90102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2820940936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90102a60 0x7f1f90102e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009900 tx=0x7f1f8002a410 comp rx=0 tx=0).stop 2024-09-21T00:44:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 -- 172.21.15.16:0/2820940936 shutdown_connections 2024-09-21T00:44:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2820940936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f90108cf0 0x7f1f9010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2820940936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f901083a0 0x7f1f901087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2820940936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90102a60 0x7f1f90102e70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 -- 172.21.15.16:0/2820940936 >> 172.21.15.16:0/2820940936 conn(0x7f1f90079730 msgr2=0x7f1f90079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 -- 172.21.15.16:0/2820940936 shutdown_connections 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.765+0000 7f1f9612a640 1 -- 172.21.15.16:0/2820940936 wait complete. 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 Processor -- start 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 -- start start 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f90102a60 0x7f1f90104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f901083a0 0x7f1f90104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 0x7f1f90104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f901129c0 con 0x7f1f90108cf0 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f90112840 con 0x7f1f90102a60 2024-09-21T00:44:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f9612a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1f90112b40 con 0x7f1f901083a0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 0x7f1f90104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 0x7f1f90104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54966/0 (socket says 172.21.15.16:54966) 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f8ffff640 1 -- 172.21.15.16:0/2707899781 learned_addr learned my addr 172.21.15.16:0/2707899781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f8f7fe640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f90102a60 0x7f1f90104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.766+0000 7f1f8effd640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f901083a0 0x7f1f90104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 -- 172.21.15.16:0/2707899781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f901083a0 msgr2=0x7f1f90104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f901083a0 0x7f1f90104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 -- 172.21.15.16:0/2707899781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f90102a60 msgr2=0x7f1f90104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f90102a60 0x7f1f90104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f901a8780 con 0x7f1f90108cf0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8ffff640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 0x7f1f90104cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b970 tx=0x7f1f8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88019070 con 0x7f1f90108cf0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f901a8a70 con 0x7f1f90108cf0 2024-09-21T00:44:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f901a9000 con 0x7f1f90108cf0 2024-09-21T00:44:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f88014440 con 0x7f1f90108cf0 2024-09-21T00:44:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.767+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f880075d0 con 0x7f1f90108cf0 2024-09-21T00:44:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.768+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f7c001060 con 0x7f1f90108cf0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.770+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f1f8801c070 con 0x7f1f90108cf0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8cff9640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1f780b6620 0x7f1f780b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8f7fe640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1f780b6620 0x7f1f780b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f1f880e7080 con 0x7f1f90108cf0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8cff9640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] conn(0x7f1f780c0010 0x7f1f780c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f88014d00 con 0x7f1f780c0010 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f1f880e7560 con 0x7f1f90108cf0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.771+0000 7f1f8effd640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] conn(0x7f1f780c0010 0x7f1f780c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.772+0000 7f1f8f7fe640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1f780b6620 0x7f1f780b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f80000c00 tx=0x7f1f80031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:57.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.772+0000 7f1f8effd640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] conn(0x7f1f780c0010 0x7f1f780c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:57.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.773+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== osd.0 v2:172.21.15.16:6802/1318446246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f88014d00 con 0x7f1f780c0010 2024-09-21T00:44:57.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.790+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 --> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f7c002e00 con 0x7f1f780c0010 2024-09-21T00:44:57.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f8cff9640 1 -- 172.21.15.16:0/2707899781 <== osd.0 v2:172.21.15.16:6802/1318446246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f7c002e00 con 0x7f1f780c0010 2024-09-21T00:44:57.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] conn(0x7f1f780c0010 msgr2=0x7f1f780c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] conn(0x7f1f780c0010 0x7f1f780c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1f780b6620 msgr2=0x7f1f780b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f1f780b6620 0x7f1f780b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f80000c00 tx=0x7f1f80031400 comp rx=0 tx=0).stop 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 msgr2=0x7f1f90104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 --2- 172.21.15.16:0/2707899781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f90108cf0 0x7f1f90104cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b970 tx=0x7f1f8800be30 comp rx=0 tx=0).stop 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f8ffff640 1 -- 172.21.15.16:0/2707899781 reap_dead start 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 shutdown_connections 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.791+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 >> 172.21.15.16:0/2707899781 conn(0x7f1f90079730 msgr2=0x7f1f90101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.792+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 shutdown_connections 2024-09-21T00:44:57.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.792+0000 7f1f9612a640 1 -- 172.21.15.16:0/2707899781 wait complete. 2024-09-21T00:44:58.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:57 smithi016 ceph-mon[30947]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 540 B/s wr, 6 op/s; 164 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:58.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 -- 172.21.15.16:0/2676685426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f4105300 msgr2=0x7f63f410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 --2- 172.21.15.16:0/2676685426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f4105300 0x7f63f410d850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009900 tx=0x7f63e402a410 comp rx=0 tx=0).stop 2024-09-21T00:44:58.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 -- 172.21.15.16:0/2676685426 shutdown_connections 2024-09-21T00:44:58.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 --2- 172.21.15.16:0/2676685426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63f410de10 0x7f63f4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 --2- 172.21.15.16:0/2676685426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f4105300 0x7f63f410d850 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 --2- 172.21.15.16:0/2676685426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f41049b0 0x7f63f4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 -- 172.21.15.16:0/2676685426 >> 172.21.15.16:0/2676685426 conn(0x7f63f4079730 msgr2=0x7f63f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 -- 172.21.15.16:0/2676685426 shutdown_connections 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.619+0000 7f63fb941640 1 -- 172.21.15.16:0/2676685426 wait complete. 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 Processor -- start 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 -- start start 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 0x7f63f419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f4105300 0x7f63f419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63f410de10 0x7f63f419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4113a70 con 0x7f63f41049b0 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63f41138f0 con 0x7f63f410de10 2024-09-21T00:44:58.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63fb941640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63f4113bf0 con 0x7f63f4105300 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 0x7f63f419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 0x7f63f419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54952/0 (socket says 172.21.15.16:54952) 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 -- 172.21.15.16:0/319986360 learned_addr learned my addr 172.21.15.16:0/319986360 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f8edc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f4105300 0x7f63f419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f9ede640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63f410de10 0x7f63f419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 -- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f4105300 msgr2=0x7f63f419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f4105300 0x7f63f419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.620+0000 7f63f96dd640 1 -- 172.21.15.16:0/319986360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63f410de10 msgr2=0x7f63f419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63f96dd640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63f410de10 0x7f63f419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63f96dd640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41a04b0 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63f8edc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63f4105300 0x7f63f419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63f96dd640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 0x7f63f419a540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f63f000d950 tx=0x7f63f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0017020 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63f0009c30 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f000f690 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41a07a0 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.621+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41a6f00 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.622+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63f4063b50 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.624+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f63f001a020 con 0x7f63f41049b0 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63ea7fc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f63e00b6620 0x7f63e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:58.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63f8edc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f63e00b6620 0x7f63e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f63f00e76c0 con 0x7f63f41049b0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63ea7fc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] conn(0x7f63e00c0010 0x7f63e00c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63e00c2bd0 con 0x7f63e00c0010 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.625+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f63f00e7ba0 con 0x7f63f41049b0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.626+0000 7f63f8edc640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f63e00b6620 0x7f63e00b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009230 tx=0x7f63e4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.626+0000 7f63f9ede640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] conn(0x7f63e00c0010 0x7f63e00c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.626+0000 7f63f9ede640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] conn(0x7f63e00c0010 0x7f63e00c2500 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.627+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== osd.5 v2:172.21.15.178:6808/1751898506 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63e00c2bd0 con 0x7f63e00c0010 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 --> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63f4063fd0 con 0x7f63e00c0010 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63ea7fc640 1 -- 172.21.15.16:0/319986360 <== osd.5 v2:172.21.15.178:6808/1751898506 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f63f4063fd0 con 0x7f63e00c0010 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] conn(0x7f63e00c0010 msgr2=0x7f63e00c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] conn(0x7f63e00c0010 0x7f63e00c2500 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f63e00b6620 msgr2=0x7f63e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f63e00b6620 0x7f63e00b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009230 tx=0x7f63e4000bc0 comp rx=0 tx=0).stop 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 msgr2=0x7f63f419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.641+0000 7f63fb941640 1 --2- 172.21.15.16:0/319986360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f41049b0 0x7f63f419a540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f63f000d950 tx=0x7f63f000de10 comp rx=0 tx=0).stop 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.642+0000 7f63f9ede640 1 -- 172.21.15.16:0/319986360 reap_dead start 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.642+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 shutdown_connections 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.642+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 >> 172.21.15.16:0/319986360 conn(0x7f63f4079730 msgr2=0x7f63f4100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.642+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 shutdown_connections 2024-09-21T00:44:58.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:57.642+0000 7f63fb941640 1 -- 172.21.15.16:0/319986360 wait complete. 2024-09-21T00:44:58.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:57 smithi123 ceph-mon[34853]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 540 B/s wr, 6 op/s; 164 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:58.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:57 smithi178 ceph-mon[34888]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 540 B/s wr, 6 op/s; 164 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T00:44:58.745 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:58.745 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:58.745 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:58.745 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:58.772 INFO:teuthology.orchestra.run.smithi016.stdout:34359738445 2024-09-21T00:44:58.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T00:44:59.510 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:59.510 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:59.511 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:59.511 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:44:59.511 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:44:59 smithi016 ceph-mon[30947]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 782 B/s wr, 10 op/s; 149 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T00:45:00.078 INFO:teuthology.orchestra.run.smithi016.stdout:141733920819 2024-09-21T00:45:00.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T00:45:00.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:44:59 smithi123 ceph-mon[34853]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 782 B/s wr, 10 op/s; 149 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T00:45:00.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:44:59 smithi178 ceph-mon[34888]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 782 B/s wr, 10 op/s; 149 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T00:45:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 -- 172.21.15.16:0/2071190005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 msgr2=0x7f9aac110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 --2- 172.21.15.16:0/2071190005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac110620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009ca0 tx=0x7f9aa402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 -- 172.21.15.16:0/2071190005 shutdown_connections 2024-09-21T00:45:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 --2- 172.21.15.16:0/2071190005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac110620 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 --2- 172.21.15.16:0/2071190005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac1094a0 0x7f9aac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 --2- 172.21.15.16:0/2071190005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac103b60 0x7f9aac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 -- 172.21.15.16:0/2071190005 >> 172.21.15.16:0/2071190005 conn(0x7f9aac07b850 msgr2=0x7f9aac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 -- 172.21.15.16:0/2071190005 shutdown_connections 2024-09-21T00:45:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.741+0000 7f9ab3083640 1 -- 172.21.15.16:0/2071190005 wait complete. 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.742+0000 7f9ab3083640 1 Processor -- start 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.742+0000 7f9ab3083640 1 -- start start 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.742+0000 7f9ab3083640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac103b60 0x7f9aac1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab3083640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac1094a0 0x7f9aac198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab3083640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab3083640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac1118c0 con 0x7f9aac109df0 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab3083640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac111740 con 0x7f9aac103b60 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab3083640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac111a40 con 0x7f9aac1094a0 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9aabfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac1094a0 0x7f9aac198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac19daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55012/0 (socket says 172.21.15.16:55012) 2024-09-21T00:45:00.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9aabfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac1094a0 0x7f9aac198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:43092/0 (socket says 172.21.15.16:43092) 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 -- 172.21.15.16:0/3315600590 learned_addr learned my addr 172.21.15.16:0/3315600590 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab0e1f640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac103b60 0x7f9aac1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 -- 172.21.15.16:0/3315600590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac1094a0 msgr2=0x7f9aac198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aac1094a0 0x7f9aac198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 -- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac103b60 msgr2=0x7f9aac1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac103b60 0x7f9aac1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac19e160 con 0x7f9aac109df0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab0e1f640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aac103b60 0x7f9aac1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.743+0000 7f9ab1620640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac19daf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40098d0 tx=0x7f9aa40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.744+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4003bf0 con 0x7f9aac109df0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.744+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aa4003d90 con 0x7f9aac109df0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.744+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac19e3f0 con 0x7f9aac109df0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.744+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa402fad0 con 0x7f9aac109df0 2024-09-21T00:45:00.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.744+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac19e930 con 0x7f9aac109df0 2024-09-21T00:45:00.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.745+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9aac063b50 con 0x7f9aac109df0 2024-09-21T00:45:00.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.747+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9aa402fc90 con 0x7f9aac109df0 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aa9ffb640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a980baa20 0x7f9a980bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9ab0e1f640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a980baa20 0x7f9a980bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f9aa41089f0 con 0x7f9aac109df0 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aa9ffb640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] conn(0x7f9a980c4410 0x7f9a980c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a980c6fd0 con 0x7f9a980c4410 2024-09-21T00:45:00.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9aa4108ed0 con 0x7f9aac109df0 2024-09-21T00:45:00.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9ab0e1f640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a980baa20 0x7f9a980bcf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a940058c0 tx=0x7f9a94005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.748+0000 7f9aabfff640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] conn(0x7f9a980c4410 0x7f9a980c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.749+0000 7f9aabfff640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] conn(0x7f9a980c4410 0x7f9a980c6900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.750+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== osd.10 v2:172.21.15.123:6824/2298127239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a980c6fd0 con 0x7f9a980c4410 2024-09-21T00:45:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.763+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 --> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9aac063f50 con 0x7f9a980c4410 2024-09-21T00:45:00.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.764+0000 7f9aa9ffb640 1 -- 172.21.15.16:0/3315600590 <== osd.10 v2:172.21.15.123:6824/2298127239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9aac063f50 con 0x7f9a980c4410 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.764+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] conn(0x7f9a980c4410 msgr2=0x7f9a980c6900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.764+0000 7f9ab3083640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] conn(0x7f9a980c4410 0x7f9a980c6900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a980baa20 msgr2=0x7f9a980bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a980baa20 0x7f9a980bcf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a940058c0 tx=0x7f9a94005850 comp rx=0 tx=0).stop 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 msgr2=0x7f9aac19daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 --2- 172.21.15.16:0/3315600590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac109df0 0x7f9aac19daf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40098d0 tx=0x7f9aa40319f0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab1620640 1 -- 172.21.15.16:0/3315600590 reap_dead start 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 shutdown_connections 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 >> 172.21.15.16:0/3315600590 conn(0x7f9aac07b850 msgr2=0x7f9aac1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 shutdown_connections 2024-09-21T00:45:00.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:00.765+0000 7f9ab3083640 1 -- 172.21.15.16:0/3315600590 wait complete. 2024-09-21T00:45:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.700+0000 7f978c470640 1 -- 172.21.15.16:0/271199248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 msgr2=0x7f978410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.700+0000 7f978c470640 1 --2- 172.21.15.16:0/271199248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978410f550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f977c009ca0 tx=0x7f977c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 -- 172.21.15.16:0/271199248 shutdown_connections 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 --2- 172.21.15.16:0/271199248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978410f550 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 --2- 172.21.15.16:0/271199248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 0x7f97841087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 --2- 172.21.15.16:0/271199248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 0x7f9784102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 -- 172.21.15.16:0/271199248 >> 172.21.15.16:0/271199248 conn(0x7f9784079760 msgr2=0x7f9784079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 -- 172.21.15.16:0/271199248 shutdown_connections 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 -- 172.21.15.16:0/271199248 wait complete. 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 Processor -- start 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.701+0000 7f978c470640 1 -- start start 2024-09-21T00:45:00.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 0x7f978419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 0x7f978419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9784113ab0 con 0x7f9784108d20 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9784113930 con 0x7f97841083d0 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9784113c30 con 0x7f9784102ae0 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54988/0 (socket says 172.21.15.16:54988) 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 -- 172.21.15.16:0/732767662 learned_addr learned my addr 172.21.15.16:0/732767662 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978a20c640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 0x7f978419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f9789a0b640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 0x7f978419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 -- 172.21.15.16:0/732767662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 msgr2=0x7f978419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 0x7f978419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 -- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 msgr2=0x7f978419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 0x7f978419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97841a03b0 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978a20c640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9784102ae0 0x7f978419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f9789a0b640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841083d0 0x7f978419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978aa0d640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978419fc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f977c005cc0 tx=0x7f977c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c003bf0 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f977c003d90 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c02fbc0 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.702+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97841a0640 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.703+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97841a6e00 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.703+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9784063b50 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.705+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f977c02fd60 con 0x7f9784108d20 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f977b7fe640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97700b6620 0x7f97700b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f978a20c640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97700b6620 0x7f97700b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f977c108a90 con 0x7f9784108d20 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f977b7fe640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] conn(0x7f97700c0010 0x7f97700c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97700c2bd0 con 0x7f97700c0010 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f977c108f70 con 0x7f9784108d20 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f978a20c640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97700b6620 0x7f97700b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9780005fd0 tx=0x7f9780005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.706+0000 7f9789a0b640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] conn(0x7f97700c0010 0x7f97700c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.707+0000 7f9789a0b640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] conn(0x7f97700c0010 0x7f97700c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.708+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== osd.1 v2:172.21.15.123:6800/2399482563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97700c2bd0 con 0x7f97700c0010 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.721+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 --> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9784063f50 con 0x7f97700c0010 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.722+0000 7f977b7fe640 1 -- 172.21.15.16:0/732767662 <== osd.1 v2:172.21.15.123:6800/2399482563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9784063f50 con 0x7f97700c0010 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.722+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] conn(0x7f97700c0010 msgr2=0x7f97700c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.722+0000 7f978c470640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] conn(0x7f97700c0010 0x7f97700c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97700b6620 msgr2=0x7f97700b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97700b6620 0x7f97700b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9780005fd0 tx=0x7f9780005ea0 comp rx=0 tx=0).stop 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 msgr2=0x7f978419fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 --2- 172.21.15.16:0/732767662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9784108d20 0x7f978419fc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f977c005cc0 tx=0x7f977c02f380 comp rx=0 tx=0).stop 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978aa0d640 1 -- 172.21.15.16:0/732767662 reap_dead start 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 shutdown_connections 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 >> 172.21.15.16:0/732767662 conn(0x7f9784079760 msgr2=0x7f9784105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 shutdown_connections 2024-09-21T00:45:00.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:44:59.723+0000 7f978c470640 1 -- 172.21.15.16:0/732767662 wait complete. 2024-09-21T00:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 -- 172.21.15.16:0/448532987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c109e40 msgr2=0x7fa52c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 --2- 172.21.15.16:0/448532987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c109e40 0x7fa52c110670 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa524009ca0 tx=0x7fa52402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 -- 172.21.15.16:0/448532987 shutdown_connections 2024-09-21T00:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 --2- 172.21.15.16:0/448532987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c109e40 0x7fa52c110670 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 --2- 172.21.15.16:0/448532987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c1094f0 0x7fa52c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 --2- 172.21.15.16:0/448532987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c103bb0 0x7fa52c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 -- 172.21.15.16:0/448532987 >> 172.21.15.16:0/448532987 conn(0x7fa52c0ff600 msgr2=0x7fa52c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 -- 172.21.15.16:0/448532987 shutdown_connections 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.425+0000 7fa53427e640 1 -- 172.21.15.16:0/448532987 wait complete. 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 Processor -- start 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 -- start start 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c103bb0 0x7fa52c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:01.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 0x7fa52c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c109e40 0x7fa52c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c113b00 con 0x7fa52c1094f0 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c113980 con 0x7fa52c109e40 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53427e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c113c80 con 0x7fa52c103bb0 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 0x7fa52c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 0x7fa52c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55032/0 (socket says 172.21.15.16:55032) 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 -- 172.21.15.16:0/1387328141 learned_addr learned my addr 172.21.15.16:0/1387328141 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53201a640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c103bb0 0x7fa52c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53281b640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c109e40 0x7fa52c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 -- 172.21.15.16:0/1387328141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c103bb0 msgr2=0x7fa52c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c103bb0 0x7fa52c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 -- 172.21.15.16:0/1387328141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c109e40 msgr2=0x7fa52c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c109e40 0x7fa52c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa531819640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c1a03e0 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.426+0000 7fa53281b640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa52c109e40 0x7fa52c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa531819640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 0x7fa52c19aa10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00d750 tx=0x7fa51c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c017070 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa51c0054d0 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52c1a06d0 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c004c30 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.427+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52c1a6e30 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.428+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa52c063b50 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.430+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa51c004dd0 con 0x7fa52c1094f0 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.430+0000 7fa5237fe640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa5180b6620 0x7fa5180b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa53201a640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa5180b6620 0x7fa5180b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa51c0e7110 con 0x7fa52c1094f0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa5237fe640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] conn(0x7fa5180c0010 0x7fa5180c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5180c2bd0 con 0x7fa5180c0010 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa51c0e75f0 con 0x7fa52c1094f0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa53281b640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] conn(0x7fa5180c0010 0x7fa5180c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa53201a640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa5180b6620 0x7fa5180b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa52800bbe0 tx=0x7fa52800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.431+0000 7fa53281b640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] conn(0x7fa5180c0010 0x7fa5180c2500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.432+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== osd.9 v2:172.21.15.16:6826/726892379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5180c2bd0 con 0x7fa5180c0010 2024-09-21T00:45:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.446+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 --> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa52c063fd0 con 0x7fa5180c0010 2024-09-21T00:45:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.446+0000 7fa5237fe640 1 -- 172.21.15.16:0/1387328141 <== osd.9 v2:172.21.15.16:6826/726892379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa52c063fd0 con 0x7fa5180c0010 2024-09-21T00:45:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.446+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] conn(0x7fa5180c0010 msgr2=0x7fa5180c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] conn(0x7fa5180c0010 0x7fa5180c2500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa5180b6620 msgr2=0x7fa5180b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa5180b6620 0x7fa5180b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa52800bbe0 tx=0x7fa52800b390 comp rx=0 tx=0).stop 2024-09-21T00:45:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 msgr2=0x7fa52c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 --2- 172.21.15.16:0/1387328141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa52c1094f0 0x7fa52c19aa10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00d750 tx=0x7fa51c00dc10 comp rx=0 tx=0).stop 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53281b640 1 -- 172.21.15.16:0/1387328141 reap_dead start 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 shutdown_connections 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 >> 172.21.15.16:0/1387328141 conn(0x7fa52c0ff600 msgr2=0x7fa52c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 shutdown_connections 2024-09-21T00:45:01.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:01.447+0000 7fa53427e640 1 -- 172.21.15.16:0/1387328141 wait complete. 2024-09-21T00:45:01.746 INFO:teuthology.orchestra.run.smithi016.stdout:55834574921 2024-09-21T00:45:01.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T00:45:02.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:01 smithi016 ceph-mon[30947]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:02.089 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:01 smithi178 ceph-mon[34888]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:02.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:01 smithi123 ceph-mon[34853]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:02.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 -- 172.21.15.16:0/3886428495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f4108d10 msgr2=0x7fa2f410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 --2- 172.21.15.16:0/3886428495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f4108d10 0x7fa2f410f540 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009ca0 tx=0x7fa2ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 -- 172.21.15.16:0/3886428495 shutdown_connections 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 --2- 172.21.15.16:0/3886428495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f4108d10 0x7fa2f410f540 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 --2- 172.21.15.16:0/3886428495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f41083c0 0x7fa2f41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 --2- 172.21.15.16:0/3886428495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f4102a80 0x7fa2f4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 -- 172.21.15.16:0/3886428495 >> 172.21.15.16:0/3886428495 conn(0x7fa2f4079740 msgr2=0x7fa2f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 -- 172.21.15.16:0/3886428495 shutdown_connections 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.895+0000 7fa2f8961640 1 -- 172.21.15.16:0/3886428495 wait complete. 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 Processor -- start 2024-09-21T00:45:02.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 -- start start 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f4102a80 0x7fa2f419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 0x7fa2f419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f4108d10 0x7fa2f419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4112a00 con 0x7fa2f41083c0 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4112880 con 0x7fa2f4102a80 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f8961640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4112b80 con 0x7fa2f4108d10 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 0x7fa2f419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 0x7fa2f419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55036/0 (socket says 172.21.15.16:55036) 2024-09-21T00:45:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f1d9b640 1 -- 172.21.15.16:0/2484227820 learned_addr learned my addr 172.21.15.16:0/2484227820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f259c640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f4102a80 0x7fa2f419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.896+0000 7fa2f2d9d640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f4108d10 0x7fa2f419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 -- 172.21.15.16:0/2484227820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f4108d10 msgr2=0x7fa2f419bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f4108d10 0x7fa2f419bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 -- 172.21.15.16:0/2484227820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f4102a80 msgr2=0x7fa2f419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2f4102a80 0x7fa2f419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f41a6600 con 0x7fa2f41083c0 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f1d9b640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 0x7fa2f419b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b450 tx=0x7fa2e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8015020 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e8011d40 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800f340 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f41a68f0 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.897+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f41a6e30 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.898+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2f4063b50 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.900+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa2e8018020 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.900+0000 7fa2e37fe640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2dc0b65d0 0x7fa2dc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2f259c640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2dc0b65d0 0x7fa2dc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa2e80e7390 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2e37fe640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] conn(0x7fa2dc0bffc0 0x7fa2dc0c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2e8021e70 con 0x7fa2dc0bffc0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa2e80e7870 con 0x7fa2f41083c0 2024-09-21T00:45:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2f2d9d640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] conn(0x7fa2dc0bffc0 0x7fa2dc0c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:02.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2f259c640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2dc0b65d0 0x7fa2dc0b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40058c0 tx=0x7fa2e400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:02.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.901+0000 7fa2f2d9d640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] conn(0x7fa2dc0bffc0 0x7fa2dc0c24b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:02.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.902+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== osd.6 v2:172.21.15.16:6818/562709826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e8021e70 con 0x7fa2dc0bffc0 2024-09-21T00:45:02.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.916+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 --> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2f4063fd0 con 0x7fa2dc0bffc0 2024-09-21T00:45:02.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2e37fe640 1 -- 172.21.15.16:0/2484227820 <== osd.6 v2:172.21.15.16:6818/562709826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2f4063fd0 con 0x7fa2dc0bffc0 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] conn(0x7fa2dc0bffc0 msgr2=0x7fa2dc0c24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] conn(0x7fa2dc0bffc0 0x7fa2dc0c24b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2dc0b65d0 msgr2=0x7fa2dc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2dc0b65d0 0x7fa2dc0b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40058c0 tx=0x7fa2e400a250 comp rx=0 tx=0).stop 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 msgr2=0x7fa2f419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 --2- 172.21.15.16:0/2484227820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f41083c0 0x7fa2f419b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b450 tx=0x7fa2e800b910 comp rx=0 tx=0).stop 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f2d9d640 1 -- 172.21.15.16:0/2484227820 reap_dead start 2024-09-21T00:45:02.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 shutdown_connections 2024-09-21T00:45:02.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.917+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 >> 172.21.15.16:0/2484227820 conn(0x7fa2f4079740 msgr2=0x7fa2f4105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:02.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.918+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 shutdown_connections 2024-09-21T00:45:02.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:02.918+0000 7fa2f8961640 1 -- 172.21.15.16:0/2484227820 wait complete. 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 -- 172.21.15.16:0/1273485691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 msgr2=0x7f83ac10d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 --2- 172.21.15.16:0/1273485691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac10d860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009900 tx=0x7f83a002a3f0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 -- 172.21.15.16:0/1273485691 shutdown_connections 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 --2- 172.21.15.16:0/1273485691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83ac10de20 0x7f83ac110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 --2- 172.21.15.16:0/1273485691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac10d860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 --2- 172.21.15.16:0/1273485691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83ac1049c0 0x7f83ac104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 -- 172.21.15.16:0/1273485691 >> 172.21.15.16:0/1273485691 conn(0x7f83ac079730 msgr2=0x7f83ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 -- 172.21.15.16:0/1273485691 shutdown_connections 2024-09-21T00:45:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.316+0000 7f83b1b73640 1 -- 172.21.15.16:0/1273485691 wait complete. 2024-09-21T00:45:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 Processor -- start 2024-09-21T00:45:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 -- start start 2024-09-21T00:45:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83ac1049c0 0x7f83ac19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83ac10de20 0x7f83ac19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113a80 con 0x7f83ac105310 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113900 con 0x7f83ac1049c0 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.317+0000 7f83b1b73640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113c00 con 0x7f83ac10de20 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55050/0 (socket says 172.21.15.16:55050) 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 -- 172.21.15.16:0/4036615693 learned_addr learned my addr 172.21.15.16:0/4036615693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83ab7fe640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83ac1049c0 0x7f83ac19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83abfff640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83ac10de20 0x7f83ac19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 -- 172.21.15.16:0/4036615693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83ac10de20 msgr2=0x7f83ac19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83ac10de20 0x7f83ac19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 -- 172.21.15.16:0/4036615693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83ac1049c0 msgr2=0x7f83ac19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83ac1049c0 0x7f83ac19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac1a0360 con 0x7f83ac105310 2024-09-21T00:45:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83aaffd640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac19aa50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f83a0006010 tx=0x7f83a0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a003f030 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a0003aa0 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0035070 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.318+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac1a05f0 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.319+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1a0ad0 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.320+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83ac063b50 con 0x7f83ac105310 2024-09-21T00:45:03.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.321+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f83a0042030 con 0x7f83ac105310 2024-09-21T00:45:03.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83a8ff9640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83940b65d0 0x7f83940b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:03.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83ab7fe640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83940b65d0 0x7f83940b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:03.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f83a0107820 con 0x7f83ac105310 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83a8ff9640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] conn(0x7f83940bffc0 0x7f83940c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83a003ce50 con 0x7f83940bffc0 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.322+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f83a0107d00 con 0x7f83ac105310 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.323+0000 7f83abfff640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] conn(0x7f83940bffc0 0x7f83940c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.323+0000 7f83ab7fe640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83940b65d0 0x7f83940b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f83ac06c8e0 tx=0x7f839c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.323+0000 7f83abfff640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] conn(0x7f83940bffc0 0x7f83940c24b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:03.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.324+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== osd.3 v2:172.21.15.16:6810/1166375609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83a003ce50 con 0x7f83940bffc0 2024-09-21T00:45:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.337+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 --> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83ac063fd0 con 0x7f83940bffc0 2024-09-21T00:45:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83a8ff9640 1 -- 172.21.15.16:0/4036615693 <== osd.3 v2:172.21.15.16:6810/1166375609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f83ac063fd0 con 0x7f83940bffc0 2024-09-21T00:45:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] conn(0x7f83940bffc0 msgr2=0x7f83940c24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] conn(0x7f83940bffc0 0x7f83940c24b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83940b65d0 msgr2=0x7f83940b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83940b65d0 0x7f83940b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f83ac06c8e0 tx=0x7f839c005f90 comp rx=0 tx=0).stop 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 msgr2=0x7f83ac19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 --2- 172.21.15.16:0/4036615693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83ac105310 0x7f83ac19aa50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f83a0006010 tx=0x7f83a0004060 comp rx=0 tx=0).stop 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83abfff640 1 -- 172.21.15.16:0/4036615693 reap_dead start 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 shutdown_connections 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 >> 172.21.15.16:0/4036615693 conn(0x7f83ac079730 msgr2=0x7f83ac100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 shutdown_connections 2024-09-21T00:45:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.338+0000 7f83b1b73640 1 -- 172.21.15.16:0/4036615693 wait complete. 2024-09-21T00:45:03.972 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:03 smithi016 ceph-mon[30947]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:04.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:03 smithi123 ceph-mon[34853]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:04.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:03 smithi178 ceph-mon[34888]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s; 130 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:04.428 INFO:teuthology.orchestra.run.smithi016.stdout:261993005082 2024-09-21T00:45:04.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 -- 172.21.15.16:0/1619990498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa81083b0 msgr2=0x7f9aa81087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/1619990498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa81083b0 0x7f9aa81087c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009900 tx=0x7f9a9002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 -- 172.21.15.16:0/1619990498 shutdown_connections 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/1619990498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8108d00 0x7f9aa810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/1619990498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa81083b0 0x7f9aa81087c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/1619990498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8102a70 0x7f9aa8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 -- 172.21.15.16:0/1619990498 >> 172.21.15.16:0/1619990498 conn(0x7f9aa8079730 msgr2=0x7f9aa8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:04.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 -- 172.21.15.16:0/1619990498 shutdown_connections 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 -- 172.21.15.16:0/1619990498 wait complete. 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.064+0000 7f9aad5f4640 1 Processor -- start 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 -- start start 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8102a70 0x7f9aa819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa81083b0 0x7f9aa819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 0x7f9aa819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8113ab0 con 0x7f9aa8108d00 2024-09-21T00:45:04.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8113930 con 0x7f9aa81083b0 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aad5f4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8113c30 con 0x7f9aa8102a70 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 0x7f9aa819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 0x7f9aa819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55106/0 (socket says 172.21.15.16:55106) 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 -- 172.21.15.16:0/2269505441 learned_addr learned my addr 172.21.15.16:0/2269505441 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa67fc640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa81083b0 0x7f9aa819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa6ffd640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8102a70 0x7f9aa819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 -- 172.21.15.16:0/2269505441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8102a70 msgr2=0x7f9aa819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8102a70 0x7f9aa819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 -- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa81083b0 msgr2=0x7f9aa819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa81083b0 0x7f9aa819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81a04b0 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa6ffd640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa8102a70 0x7f9aa819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa67fc640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa81083b0 0x7f9aa819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.065+0000 7f9aa77fe640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 0x7f9aa819fd80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d750 tx=0x7f9aa000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.066+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0017070 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.066+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa81a07a0 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.066+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aa00054d0 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.066+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004c60 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.066+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa81a6f00 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.067+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9aa8063b50 con 0x7f9aa8108d00 2024-09-21T00:45:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.069+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9aa0009bd0 con 0x7f9aa8108d00 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.069+0000 7f9a9ffff640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a940b65a0 0x7f9a940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9aa6ffd640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a940b65a0 0x7f9a940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f9aa00e7440 con 0x7f9aa8108d00 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9a9ffff640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] conn(0x7f9a940bff90 0x7f9a940c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9aa0021e50 con 0x7f9a940bff90 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9aa00e7920 con 0x7f9aa8108d00 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9aa6ffd640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a940b65a0 0x7f9a940b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007eb0 tx=0x7f9a980073c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.070+0000 7f9aa67fc640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] conn(0x7f9a940bff90 0x7f9a940c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.071+0000 7f9aa67fc640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] conn(0x7f9a940bff90 0x7f9a940c2480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.072+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== osd.4 v2:172.21.15.123:6808/1012246785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9aa0021e50 con 0x7f9a940bff90 2024-09-21T00:45:04.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.085+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 --> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9aa8063f80 con 0x7f9a940bff90 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.086+0000 7f9a9ffff640 1 -- 172.21.15.16:0/2269505441 <== osd.4 v2:172.21.15.123:6808/1012246785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9aa8063f80 con 0x7f9a940bff90 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.086+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] conn(0x7f9a940bff90 msgr2=0x7f9a940c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.086+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] conn(0x7f9a940bff90 0x7f9a940c2480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a940b65a0 msgr2=0x7f9a940b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9a940b65a0 0x7f9a940b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007eb0 tx=0x7f9a980073c0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 msgr2=0x7f9aa819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 --2- 172.21.15.16:0/2269505441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aa8108d00 0x7f9aa819fd80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d750 tx=0x7f9aa000dc10 comp rx=0 tx=0).stop 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aa77fe640 1 -- 172.21.15.16:0/2269505441 reap_dead start 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 shutdown_connections 2024-09-21T00:45:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 >> 172.21.15.16:0/2269505441 conn(0x7f9aa8079730 msgr2=0x7f9aa81052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:04.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 shutdown_connections 2024-09-21T00:45:04.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:04.087+0000 7f9aad5f4640 1 -- 172.21.15.16:0/2269505441 wait complete. 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- 172.21.15.16:0/3124506266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80401083d0 msgr2=0x7f80401087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 --2- 172.21.15.16:0/3124506266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80401083d0 0x7f80401087e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8034009900 tx=0x7f803402a410 comp rx=0 tx=0).stop 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- 172.21.15.16:0/3124506266 shutdown_connections 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 --2- 172.21.15.16:0/3124506266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8040108d20 0x7f804010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 --2- 172.21.15.16:0/3124506266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80401083d0 0x7f80401087e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 --2- 172.21.15.16:0/3124506266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8040102a90 0x7f8040102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- 172.21.15.16:0/3124506266 >> 172.21.15.16:0/3124506266 conn(0x7f8040079750 msgr2=0x7f8040079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- 172.21.15.16:0/3124506266 shutdown_connections 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- 172.21.15.16:0/3124506266 wait complete. 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 Processor -- start 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.749+0000 7f80468ed640 1 -- start start 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 0x7f8040199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80401083d0 0x7f8040199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8040108d20 0x7f804019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80401129d0 con 0x7f8040102a90 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8040112850 con 0x7f80401083d0 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f80468ed640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8040112b50 con 0x7f8040108d20 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 0x7f8040199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 0x7f8040199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55076/0 (socket says 172.21.15.16:55076) 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 -- 172.21.15.16:0/665976659 learned_addr learned my addr 172.21.15.16:0/665976659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803f7fe640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80401083d0 0x7f8040199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 -- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8040108d20 msgr2=0x7f804019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f8044e8a640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8040108d20 0x7f804019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8040108d20 0x7f804019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 -- 172.21.15.16:0/665976659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80401083d0 msgr2=0x7f8040199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80401083d0 0x7f8040199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803ffff640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804019f2d0 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.750+0000 7f803f7fe640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80401083d0 0x7f8040199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f803ffff640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 0x7f8040199360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f803000d950 tx=0x7f803000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030017070 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8030009c30 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804019f5c0 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803000f620 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.751+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80401a5d20 con 0x7f8040102a90 2024-09-21T00:45:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.752+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8040063b10 con 0x7f8040102a90 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.753+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8030010460 con 0x7f8040102a90 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803d7fa640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f80280b65a0 0x7f80280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803f7fe640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f80280b65a0 0x7f80280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f80300e74f0 con 0x7f8040102a90 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803d7fa640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] conn(0x7f80280bff90 0x7f80280c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8030022e70 con 0x7f80280bff90 2024-09-21T00:45:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.754+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f80300e79d0 con 0x7f8040102a90 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.755+0000 7f803f7fe640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f80280b65a0 0x7f80280b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80340096c0 tx=0x7f8034031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.755+0000 7f8044e8a640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] conn(0x7f80280bff90 0x7f80280c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.755+0000 7f8044e8a640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] conn(0x7f80280bff90 0x7f80280c2480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.756+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== osd.2 v2:172.21.15.178:6800/231892136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8030022e70 con 0x7f80280bff90 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.770+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 --> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8040063f90 con 0x7f80280bff90 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.770+0000 7f803d7fa640 1 -- 172.21.15.16:0/665976659 <== osd.2 v2:172.21.15.178:6800/231892136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8040063f90 con 0x7f80280bff90 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] conn(0x7f80280bff90 msgr2=0x7f80280c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] conn(0x7f80280bff90 0x7f80280c2480 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f80280b65a0 msgr2=0x7f80280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f80280b65a0 0x7f80280b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80340096c0 tx=0x7f8034031400 comp rx=0 tx=0).stop 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 msgr2=0x7f8040199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 --2- 172.21.15.16:0/665976659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8040102a90 0x7f8040199360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f803000d950 tx=0x7f803000de10 comp rx=0 tx=0).stop 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f8044e8a640 1 -- 172.21.15.16:0/665976659 reap_dead start 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 shutdown_connections 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 >> 172.21.15.16:0/665976659 conn(0x7f8040079750 msgr2=0x7f8040105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 shutdown_connections 2024-09-21T00:45:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:03.771+0000 7f80468ed640 1 -- 172.21.15.16:0/665976659 wait complete. 2024-09-21T00:45:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 -- 172.21.15.16:0/4155766794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102f50 msgr2=0x7fdeec10fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 --2- 172.21.15.16:0/4155766794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102f50 0x7fdeec10fc70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009900 tx=0x7fdedc02a480 comp rx=0 tx=0).stop 2024-09-21T00:45:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 -- 172.21.15.16:0/4155766794 shutdown_connections 2024-09-21T00:45:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 --2- 172.21.15.16:0/4155766794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 0x7fdeec1125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 --2- 172.21.15.16:0/4155766794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102f50 0x7fdeec10fc70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 --2- 172.21.15.16:0/4155766794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102600 0x7fdeec102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 -- 172.21.15.16:0/4155766794 >> 172.21.15.16:0/4155766794 conn(0x7fdeec079750 msgr2=0x7fdeec079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 -- 172.21.15.16:0/4155766794 shutdown_connections 2024-09-21T00:45:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.421+0000 7fdef4196640 1 -- 172.21.15.16:0/4155766794 wait complete. 2024-09-21T00:45:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 Processor -- start 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 -- start start 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 0x7fdeec19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102f50 0x7fdeec19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 0x7fdeec1a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec115ca0 con 0x7fdeec102600 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec115b20 con 0x7fdeec1101b0 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef4196640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec115e20 con 0x7fdeec102f50 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef1f32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 0x7fdeec19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef1f32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 0x7fdeec19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47690/0 (socket says 172.21.15.16:47690) 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef1f32640 1 -- 172.21.15.16:0/80613085 learned_addr learned my addr 172.21.15.16:0/80613085 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.422+0000 7fdef2733640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 0x7fdeec1a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 -- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102f50 msgr2=0x7fdeec19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1731640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102f50 0x7fdeec19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102f50 0x7fdeec19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 -- 172.21.15.16:0/80613085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 msgr2=0x7fdeec1a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 0x7fdeec1a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec1a25e0 con 0x7fdeec102600 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef2733640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdeec1101b0 0x7fdeec1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1731640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeec102f50 0x7fdeec19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef1f32640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 0x7fdeec19c670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdee800d950 tx=0x7fdee800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8017070 con 0x7fdeec102600 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec1a28d0 con 0x7fdeec102600 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee8009c30 con 0x7fdeec102600 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee800f620 con 0x7fdeec102600 2024-09-21T00:45:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.423+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec1a9030 con 0x7fdeec102600 2024-09-21T00:45:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.424+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdeec109680 con 0x7fdeec102600 2024-09-21T00:45:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.426+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fdee8010460 con 0x7fdeec102600 2024-09-21T00:45:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.426+0000 7fdee2ffd640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fded80b65a0 0x7fded80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.426+0000 7fdef1731640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fded80b65a0 0x7fded80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdee80e7490 con 0x7fdeec102600 2024-09-21T00:45:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdee2ffd640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] conn(0x7fded80bff90 0x7fded80c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdee8022e70 con 0x7fded80bff90 2024-09-21T00:45:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fdee80e7970 con 0x7fdeec102600 2024-09-21T00:45:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdef1731640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fded80b65a0 0x7fded80b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0096c0 tx=0x7fdedc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.427+0000 7fdef2733640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] conn(0x7fded80bff90 0x7fded80c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.428+0000 7fdef2733640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] conn(0x7fded80bff90 0x7fded80c2480 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.428+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== osd.8 v2:172.21.15.178:6816/3499718195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdee8022e70 con 0x7fded80bff90 2024-09-21T00:45:05.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.443+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 --> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdeec06b350 con 0x7fded80bff90 2024-09-21T00:45:05.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdee2ffd640 1 -- 172.21.15.16:0/80613085 <== osd.8 v2:172.21.15.178:6816/3499718195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdeec06b350 con 0x7fded80bff90 2024-09-21T00:45:05.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] conn(0x7fded80bff90 msgr2=0x7fded80c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] conn(0x7fded80bff90 0x7fded80c2480 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fded80b65a0 msgr2=0x7fded80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fded80b65a0 0x7fded80b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0096c0 tx=0x7fdedc031400 comp rx=0 tx=0).stop 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 msgr2=0x7fdeec19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef4196640 1 --2- 172.21.15.16:0/80613085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec102600 0x7fdeec19c670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdee800d950 tx=0x7fdee800de10 comp rx=0 tx=0).stop 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.444+0000 7fdef2733640 1 -- 172.21.15.16:0/80613085 reap_dead start 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.445+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 shutdown_connections 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.445+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 >> 172.21.15.16:0/80613085 conn(0x7fdeec079750 msgr2=0x7fdeec108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.445+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 shutdown_connections 2024-09-21T00:45:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.445+0000 7fdef4196640 1 -- 172.21.15.16:0/80613085 wait complete. 2024-09-21T00:45:05.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2604094641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d4108cf0 msgr2=0x7fc1d410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2604094641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d4108cf0 0x7fc1d410f520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009900 tx=0x7fc1cc02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:05.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2604094641 shutdown_connections 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2604094641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d4108cf0 0x7fc1d410f520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2604094641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1d41083a0 0x7fc1d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2604094641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1d4102a60 0x7fc1d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2604094641 >> 172.21.15.16:0/2604094641 conn(0x7fc1d4079730 msgr2=0x7fc1d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2604094641 shutdown_connections 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.655+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2604094641 wait complete. 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 Processor -- start 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 -- start start 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1d4102a60 0x7fc1d419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 0x7fc1d419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1d4108cf0 0x7fc1d419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4113a70 con 0x7fc1d41083a0 2024-09-21T00:45:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41138f0 con 0x7fc1d4102a60 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d96c6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4113bf0 con 0x7fc1d4108cf0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 0x7fc1d419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 0x7fc1d419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47708/0 (socket says 172.21.15.16:47708) 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d27fc640 1 -- 172.21.15.16:0/2088102339 learned_addr learned my addr 172.21.15.16:0/2088102339 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d2ffd640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1d4102a60 0x7fc1d419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.656+0000 7fc1d37fe640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1d4108cf0 0x7fc1d419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 -- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1d4108cf0 msgr2=0x7fc1d419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1d4108cf0 0x7fc1d419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 -- 172.21.15.16:0/2088102339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1d4102a60 msgr2=0x7fc1d419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1d4102a60 0x7fc1d419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d41a0370 con 0x7fc1d41083a0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d27fc640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 0x7fc1d419a9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800e9f0 tx=0x7fc1c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800ccc0 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1c80054d0 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d41a0660 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8010430 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.657+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d41a6dc0 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.658+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1d4063ad0 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.660+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc1c80046c0 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.660+0000 7fc1bbfff640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1bc0b65a0 0x7fc1bc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1d2ffd640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1bc0b65a0 0x7fc1bc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc1c80e7b70 con 0x7fc1d41083a0 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1bbfff640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] conn(0x7fc1bc0bff90 0x7fc1bc0c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1c8009030 con 0x7fc1bc0bff90 2024-09-21T00:45:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc1c80e8050 con 0x7fc1d41083a0 2024-09-21T00:45:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1d2ffd640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1bc0b65a0 0x7fc1bc0b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4005fd0 tx=0x7fc1c4009760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.661+0000 7fc1d37fe640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] conn(0x7fc1bc0bff90 0x7fc1bc0c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.662+0000 7fc1d37fe640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] conn(0x7fc1bc0bff90 0x7fc1bc0c2480 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.662+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== osd.11 v2:172.21.15.178:6824/2747266489 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1c8009030 con 0x7fc1bc0bff90 2024-09-21T00:45:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.679+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 --> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1d4063f50 con 0x7fc1bc0bff90 2024-09-21T00:45:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.679+0000 7fc1bbfff640 1 -- 172.21.15.16:0/2088102339 <== osd.11 v2:172.21.15.178:6824/2747266489 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1d4063f50 con 0x7fc1bc0bff90 2024-09-21T00:45:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] conn(0x7fc1bc0bff90 msgr2=0x7fc1bc0c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] conn(0x7fc1bc0bff90 0x7fc1bc0c2480 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1bc0b65a0 msgr2=0x7fc1bc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1bc0b65a0 0x7fc1bc0b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4005fd0 tx=0x7fc1c4009760 comp rx=0 tx=0).stop 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 msgr2=0x7fc1d419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 --2- 172.21.15.16:0/2088102339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d41083a0 0x7fc1d419a9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800e9f0 tx=0x7fc1c800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d37fe640 1 -- 172.21.15.16:0/2088102339 reap_dead start 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 shutdown_connections 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.680+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 >> 172.21.15.16:0/2088102339 conn(0x7fc1d4079730 msgr2=0x7fc1d4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.681+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 shutdown_connections 2024-09-21T00:45:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:05.681+0000 7fc1d96c6640 1 -- 172.21.15.16:0/2088102339 wait complete. 2024-09-21T00:45:06.094 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:05 smithi016 ceph-mon[30947]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:06.095 INFO:teuthology.orchestra.run.smithi016.stdout:73014444101 2024-09-21T00:45:06.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T00:45:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:05 smithi123 ceph-mon[34853]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:05 smithi178 ceph-mon[34888]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T00:45:06.717 INFO:teuthology.orchestra.run.smithi016.stdout:98784247871 2024-09-21T00:45:06.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T00:45:07.111 INFO:teuthology.orchestra.run.smithi016.stdout:120259084347 2024-09-21T00:45:07.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T00:45:07.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:07 smithi016 ceph-mon[30947]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T00:45:07.998 INFO:teuthology.orchestra.run.smithi016.stdout:240518168609 2024-09-21T00:45:07.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T00:45:08.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:07 smithi123 ceph-mon[34853]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T00:45:08.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:07 smithi178 ceph-mon[34888]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T00:45:08.389 INFO:teuthology.orchestra.run.smithi016.stdout:214748364838 2024-09-21T00:45:08.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T00:45:09.245 INFO:teuthology.orchestra.run.smithi016.stdout:167503724592 2024-09-21T00:45:09.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T00:45:09.694 INFO:teuthology.orchestra.run.smithi016.stdout:287762808854 2024-09-21T00:45:09.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T00:45:09.774 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:09 smithi016 ceph-mon[30947]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T00:45:10.159 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.178 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.184 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:09 smithi123 ceph-mon[34853]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T00:45:10.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:09 smithi178 ceph-mon[34888]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T00:45:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 -- 172.21.15.16:0/710778208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0101083a0 msgr2=0x7fa0101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 --2- 172.21.15.16:0/710778208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0101083a0 0x7fa0101087b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa004009900 tx=0x7fa00402a410 comp rx=0 tx=0).stop 2024-09-21T00:45:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 -- 172.21.15.16:0/710778208 shutdown_connections 2024-09-21T00:45:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 --2- 172.21.15.16:0/710778208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa010108cf0 0x7fa01010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 --2- 172.21.15.16:0/710778208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0101083a0 0x7fa0101087b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 --2- 172.21.15.16:0/710778208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa010102a60 0x7fa010102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 -- 172.21.15.16:0/710778208 >> 172.21.15.16:0/710778208 conn(0x7fa010079730 msgr2=0x7fa010079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 -- 172.21.15.16:0/710778208 shutdown_connections 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.434+0000 7fa016199640 1 -- 172.21.15.16:0/710778208 wait complete. 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.435+0000 7fa016199640 1 Processor -- start 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.435+0000 7fa016199640 1 -- start start 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 0x7fa01019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101083a0 0x7fa01019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa010108cf0 0x7fa01019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113a80 con 0x7fa010102a60 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113900 con 0x7fa0101083a0 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa016199640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa010113c00 con 0x7fa010108cf0 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 0x7fa01019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:10.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 0x7fa01019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47728/0 (socket says 172.21.15.16:47728) 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 -- 172.21.15.16:0/711711327 learned_addr learned my addr 172.21.15.16:0/711711327 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00effd640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101083a0 0x7fa01019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 -- 172.21.15.16:0/711711327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa010108cf0 msgr2=0x7fa01019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa010108cf0 0x7fa01019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 -- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101083a0 msgr2=0x7fa01019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0101083a0 0x7fa01019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0101a0400 con 0x7fa010102a60 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00f7fe640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 0x7fa01019a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa00000ea80 tx=0x7fa00000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.436+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00000ce40 con 0x7fa010102a60 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.437+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0101a06f0 con 0x7fa010102a60 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.437+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa000005020 con 0x7fa010102a60 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.437+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000116d0 con 0x7fa010102a60 2024-09-21T00:45:10.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.437+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0101a6e50 con 0x7fa010102a60 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.438+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa010063b10 con 0x7fa010102a60 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.439+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa0000054d0 con 0x7fa010102a60 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00cff9640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9ff80b65a0 0x7f9ff80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00effd640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9ff80b65a0 0x7f9ff80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa0000e7b50 con 0x7fa010102a60 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00cff9640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] conn(0x7f9ff80bff90 0x7f9ff80c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa00001ce50 con 0x7f9ff80bff90 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa0000e8030 con 0x7fa010102a60 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00effd640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9ff80b65a0 0x7f9ff80b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa004000c00 tx=0x7fa004031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.440+0000 7fa00ffff640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] conn(0x7f9ff80bff90 0x7f9ff80c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.441+0000 7fa00ffff640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] conn(0x7f9ff80bff90 0x7f9ff80c2480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:10.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.442+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== osd.7 v2:172.21.15.123:6816/2228888488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa00001ce50 con 0x7f9ff80bff90 2024-09-21T00:45:10.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.457+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 --> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa010063fc0 con 0x7f9ff80bff90 2024-09-21T00:45:10.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa00cff9640 1 -- 172.21.15.16:0/711711327 <== osd.7 v2:172.21.15.123:6816/2228888488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa010063fc0 con 0x7f9ff80bff90 2024-09-21T00:45:10.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] conn(0x7f9ff80bff90 msgr2=0x7f9ff80c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] conn(0x7f9ff80bff90 0x7f9ff80c2480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:10.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9ff80b65a0 msgr2=0x7f9ff80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9ff80b65a0 0x7f9ff80b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa004000c00 tx=0x7fa004031400 comp rx=0 tx=0).stop 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 msgr2=0x7fa01019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 --2- 172.21.15.16:0/711711327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa010102a60 0x7fa01019a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa00000ea80 tx=0x7fa00000ef40 comp rx=0 tx=0).stop 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa00ffff640 1 -- 172.21.15.16:0/711711327 reap_dead start 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 shutdown_connections 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 >> 172.21.15.16:0/711711327 conn(0x7fa010079730 msgr2=0x7fa0101052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.458+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 shutdown_connections 2024-09-21T00:45:10.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:10.459+0000 7fa016199640 1 -- 172.21.15.16:0/711711327 wait complete. 2024-09-21T00:45:11.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.160+0000 7f8b70ce1640 1 -- 172.21.15.16:0/1158052511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 msgr2=0x7f8b6c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.160+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/1158052511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c1087d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009900 tx=0x7f8b6002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 -- 172.21.15.16:0/1158052511 shutdown_connections 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/1158052511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c108d10 0x7f8b6c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/1158052511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c1087d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/1158052511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c102a80 0x7f8b6c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 -- 172.21.15.16:0/1158052511 >> 172.21.15.16:0/1158052511 conn(0x7f8b6c079740 msgr2=0x7f8b6c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 -- 172.21.15.16:0/1158052511 shutdown_connections 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 -- 172.21.15.16:0/1158052511 wait complete. 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 Processor -- start 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.161+0000 7f8b70ce1640 1 -- start start 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 0x7f8b6c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:11.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c108d10 0x7f8b6c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c112980 con 0x7f8b6c1083c0 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c112800 con 0x7f8b6c102a80 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b70ce1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c112b00 con 0x7f8b6c108d10 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47752/0 (socket says 172.21.15.16:47752) 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 -- 172.21.15.16:0/2537706382 learned_addr learned my addr 172.21.15.16:0/2537706382 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b6ad9d640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c108d10 0x7f8b6c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b6a59c640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 0x7f8b6c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 -- 172.21.15.16:0/2537706382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c108d10 msgr2=0x7f8b6c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c108d10 0x7f8b6c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 -- 172.21.15.16:0/2537706382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 msgr2=0x7f8b6c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 0x7f8b6c19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 -- 172.21.15.16:0/2537706382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c1a66a0 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b6a59c640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 0x7f8b6c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.162+0000 7f8b69d9b640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b60032fd0 tx=0x7f8b60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.163+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6003f030 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.163+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c1a6930 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.163+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b60004490 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.163+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60035070 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.163+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c1a6e60 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.164+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c103d00 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.165+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8b60042030 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.166+0000 7f8b5b7fe640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 0x7f8b540b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.166+0000 7f8b6a59c640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 0x7f8b540b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.166+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8b60107ca0 con 0x7f8b6c1083c0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.167+0000 7f8b6a59c640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 0x7f8b540b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c005d00 tx=0x7f8b5c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:11.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.169+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b600ce4c0 con 0x7f8b6c1083c0 2024-09-21T00:45:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.366+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8b6c10ab00 con 0x7f8b6c1083c0 2024-09-21T00:45:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.366+0000 7f8b5b7fe640 1 -- 172.21.15.16:0/2537706382 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b600d28a0 con 0x7f8b6c1083c0 2024-09-21T00:45:11.367 INFO:teuthology.orchestra.run.smithi016.stdout:34359738448 2024-09-21T00:45:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 msgr2=0x7f8b540b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 0x7f8b540b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c005d00 tx=0x7f8b5c005c70 comp rx=0 tx=0).stop 2024-09-21T00:45:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 msgr2=0x7f8b6c19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b60032fd0 tx=0x7f8b60004270 comp rx=0 tx=0).stop 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 shutdown_connections 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b540b65d0 0x7f8b540b8ae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b6c108d10 0x7f8b6c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b6c1083c0 0x7f8b6c19b950 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 --2- 172.21.15.16:0/2537706382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c102a80 0x7f8b6c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 >> 172.21.15.16:0/2537706382 conn(0x7f8b6c079740 msgr2=0x7f8b6c104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.368+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 shutdown_connections 2024-09-21T00:45:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:11.369+0000 7f8b70ce1640 1 -- 172.21.15.16:0/2537706382 wait complete. 2024-09-21T00:45:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:11 smithi016 ceph-mon[30947]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:12.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:11 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:45:12.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:11 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2537706382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:45:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:11 smithi178 ceph-mon[34888]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:11 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:45:12.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:11 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2537706382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:45:12.058 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:11 smithi123 ceph-mon[34853]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:12.058 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:11 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:45:12.058 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:11 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2537706382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:45:12.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738448 for osd.0 2024-09-21T00:45:12.985 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 -- 172.21.15.16:0/123326345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 msgr2=0x7f5ac4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 --2- 172.21.15.16:0/123326345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac4102ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009900 tx=0x7f5ab402a410 comp rx=0 tx=0).stop 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 -- 172.21.15.16:0/123326345 shutdown_connections 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 --2- 172.21.15.16:0/123326345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108d70 0x7f5ac410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 --2- 172.21.15.16:0/123326345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108420 0x7f5ac4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 --2- 172.21.15.16:0/123326345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac4102ef0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 -- 172.21.15.16:0/123326345 >> 172.21.15.16:0/123326345 conn(0x7f5ac4079770 msgr2=0x7f5ac4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 -- 172.21.15.16:0/123326345 shutdown_connections 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.150+0000 7f5aca249640 1 -- 172.21.15.16:0/123326345 wait complete. 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.151+0000 7f5aca249640 1 Processor -- start 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 -- start start 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 0x7f5ac419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108d70 0x7f5ac419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4112a30 con 0x7f5ac4102ae0 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41128b0 con 0x7f5ac4108420 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5aca249640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4112bb0 con 0x7f5ac4108d70 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47790/0 (socket says 172.21.15.16:47790) 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 -- 172.21.15.16:0/1918251600 learned_addr learned my addr 172.21.15.16:0/1918251600 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac3fff640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108d70 0x7f5ac419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac2ffd640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 0x7f5ac419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 -- 172.21.15.16:0/1918251600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108d70 msgr2=0x7f5ac419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108d70 0x7f5ac419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 -- 172.21.15.16:0/1918251600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 msgr2=0x7f5ac419b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 0x7f5ac419b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.152+0000 7f5ac37fe640 1 -- 172.21.15.16:0/1918251600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac41a6630 con 0x7f5ac4102ae0 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5ac2ffd640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 0x7f5ac419b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5ac37fe640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005940 tx=0x7f5ab40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab403f030 con 0x7f5ac4102ae0 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac41a68c0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ab4003cb0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4035070 con 0x7f5ac4102ae0 2024-09-21T00:45:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.153+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41a6df0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.154+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4103d60 con 0x7f5ac4102ae0 2024-09-21T00:45:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.157+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5ab4042030 con 0x7f5ac4102ae0 2024-09-21T00:45:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.158+0000 7f5ac0ff9640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.158+0000 7f5ac2ffd640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.158+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5ab4107fe0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.158+0000 7f5ac2ffd640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 0x7f5ab00b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5aac005d00 tx=0x7f5aac005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:13.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.161+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ab40ce740 con 0x7f5ac4102ae0 2024-09-21T00:45:13.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.350+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5ac406bfd0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.350+0000 7f5ac0ff9640 1 -- 172.21.15.16:0/1918251600 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ac406bfd0 con 0x7f5ac4102ae0 2024-09-21T00:45:13.351 INFO:teuthology.orchestra.run.smithi016.stdout:73014444103 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 msgr2=0x7f5ab00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 0x7f5ab00b8b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5aac005d00 tx=0x7f5aac005c70 comp rx=0 tx=0).stop 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 msgr2=0x7f5ac419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005940 tx=0x7f5ab40042f0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 shutdown_connections 2024-09-21T00:45:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac4108d70 0x7f5ac419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac4108420 0x7f5ac419b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 --2- 172.21.15.16:0/1918251600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4102ae0 0x7f5ac419b320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 >> 172.21.15.16:0/1918251600 conn(0x7f5ac4079770 msgr2=0x7f5ac4106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 shutdown_connections 2024-09-21T00:45:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:13.353+0000 7f5aca249640 1 -- 172.21.15.16:0/1918251600 wait complete. 2024-09-21T00:45:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:13.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:13.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1256102869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:45:13.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:13 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1918251600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1256102869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:45:14.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:13 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1918251600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:45:14.022 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444101 got 73014444103 for osd.2 2024-09-21T00:45:14.023 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:14.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1256102869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:45:14.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:13 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1918251600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 -- 172.21.15.16:0/3646215524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 msgr2=0x7f61481098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3646215524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f61481098c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f613c009900 tx=0x7f613c02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 -- 172.21.15.16:0/3646215524 shutdown_connections 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3646215524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 0x7f6148110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3646215524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f61481098c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3646215524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f6148102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 -- 172.21.15.16:0/3646215524 >> 172.21.15.16:0/3646215524 conn(0x7f6148077c60 msgr2=0x7f61480780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:14.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 -- 172.21.15.16:0/3646215524 shutdown_connections 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.178+0000 7f614d2b6640 1 -- 172.21.15.16:0/3646215524 wait complete. 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 Processor -- start 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 -- start start 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f614819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 0x7f614819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113ac0 con 0x7f61481094b0 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113940 con 0x7f6148109e00 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f614d2b6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113c40 con 0x7f6148101f70 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59842/0 (socket says 172.21.15.16:59842) 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 -- 172.21.15.16:0/3302262804 learned_addr learned my addr 172.21.15.16:0/3302262804 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61477fe640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 0x7f614819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f6146ffd640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f614819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 -- 172.21.15.16:0/3302262804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 msgr2=0x7f614819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f614819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 -- 172.21.15.16:0/3302262804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 msgr2=0x7f614819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.179+0000 7f61467fc640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 0x7f614819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f61467fc640 1 -- 172.21.15.16:0/3302262804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61481a03c0 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f6146ffd640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f614819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f61467fc640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f613c02a930 tx=0x7f613c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c03f030 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f613c003aa0 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61481a0650 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c035070 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.180+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61481a6e10 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.181+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614806ac50 con 0x7f61481094b0 2024-09-21T00:45:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.182+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f613c042030 con 0x7f61481094b0 2024-09-21T00:45:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.183+0000 7f612ffff640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 0x7f61300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.183+0000 7f6146ffd640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 0x7f61300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.184+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f613c107b90 con 0x7f61481094b0 2024-09-21T00:45:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.184+0000 7f6146ffd640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 0x7f61300b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6138005fd0 tx=0x7f61380093e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.188+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f613c0ce2b0 con 0x7f61481094b0 2024-09-21T00:45:14.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.385+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f614810bbf0 con 0x7f61481094b0 2024-09-21T00:45:14.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.385+0000 7f612ffff640 1 -- 172.21.15.16:0/3302262804 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f613c0d2690 con 0x7f61481094b0 2024-09-21T00:45:14.388 INFO:teuthology.orchestra.run.smithi016.stdout:141733920822 2024-09-21T00:45:14.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 msgr2=0x7f61300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 0x7f61300b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6138005fd0 tx=0x7f61380093e0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 msgr2=0x7f614819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f613c02a930 tx=0x7f613c004270 comp rx=0 tx=0).stop 2024-09-21T00:45:14.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 shutdown_connections 2024-09-21T00:45:14.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61300b65a0 0x7f61300b8ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6148109e00 0x7f614819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61481094b0 0x7f614819a9f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 --2- 172.21.15.16:0/3302262804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6148101f70 0x7f614819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 >> 172.21.15.16:0/3302262804 conn(0x7f6148077c60 msgr2=0x7f6148107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 shutdown_connections 2024-09-21T00:45:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.388+0000 7f614d2b6640 1 -- 172.21.15.16:0/3302262804 wait complete. 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 -- 172.21.15.16:0/2553075907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a81094a0 msgr2=0x7f86a81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 --2- 172.21.15.16:0/2553075907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a81094a0 0x7f86a81098b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f869c009900 tx=0x7f869c02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 -- 172.21.15.16:0/2553075907 shutdown_connections 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 --2- 172.21.15.16:0/2553075907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8109df0 0x7f86a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 --2- 172.21.15.16:0/2553075907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a81094a0 0x7f86a81098b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 --2- 172.21.15.16:0/2553075907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a8103b60 0x7f86a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 -- 172.21.15.16:0/2553075907 >> 172.21.15.16:0/2553075907 conn(0x7f86a807b850 msgr2=0x7f86a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:14.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 -- 172.21.15.16:0/2553075907 shutdown_connections 2024-09-21T00:45:14.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.514+0000 7f86af05b640 1 -- 172.21.15.16:0/2553075907 wait complete. 2024-09-21T00:45:14.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 Processor -- start 2024-09-21T00:45:14.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 -- start start 2024-09-21T00:45:14.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8103b60 0x7f86a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a81094a0 0x7f86a8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8113ab0 con 0x7f86a8109df0 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8113930 con 0x7f86a8103b60 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86af05b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8113c30 con 0x7f86a81094a0 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86ad5f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86ad5f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59858/0 (socket says 172.21.15.16:59858) 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86ad5f8640 1 -- 172.21.15.16:0/2068095165 learned_addr learned my addr 172.21.15.16:0/2068095165 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86acdf7640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8103b60 0x7f86a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.515+0000 7f86a7fff640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a81094a0 0x7f86a8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 -- 172.21.15.16:0/2068095165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a81094a0 msgr2=0x7f86a8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a81094a0 0x7f86a8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 -- 172.21.15.16:0/2068095165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8103b60 msgr2=0x7f86a8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8103b60 0x7f86a8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 -- 172.21.15.16:0/2068095165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a81a8800 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86ad5f8640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eaa0 tx=0x7f86a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a000cdb0 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86a0005020 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a81a8af0 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a00116d0 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.516+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81a9000 con 0x7f86a8109df0 2024-09-21T00:45:14.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.517+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a8103f70 con 0x7f86a8109df0 2024-09-21T00:45:14.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.519+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f86a00051d0 con 0x7f86a8109df0 2024-09-21T00:45:14.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.520+0000 7f86a5ffb640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 0x7f86900b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.520+0000 7f86acdf7640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 0x7f86900b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.520+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f86a00e73e0 con 0x7f86a8109df0 2024-09-21T00:45:14.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.520+0000 7f86acdf7640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 0x7f86900b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86a8077160 tx=0x7f869800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.524+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86a0016030 con 0x7f86a8109df0 2024-09-21T00:45:14.705 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:14.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:14 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3302262804' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:45:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.717+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f86a802e640 con 0x7f86a8109df0 2024-09-21T00:45:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.718+0000 7f86a5ffb640 1 -- 172.21.15.16:0/2068095165 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86a00b1fe0 con 0x7f86a8109df0 2024-09-21T00:45:14.719 INFO:teuthology.orchestra.run.smithi016.stdout:55834574924 2024-09-21T00:45:14.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 msgr2=0x7f86900b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 0x7f86900b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86a8077160 tx=0x7f869800b410 comp rx=0 tx=0).stop 2024-09-21T00:45:14.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 msgr2=0x7f86a8076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eaa0 tx=0x7f86a000ef60 comp rx=0 tx=0).stop 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 shutdown_connections 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f86900b6620 0x7f86900b8b30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a8109df0 0x7f86a8076190 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a81094a0 0x7f86a8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 --2- 172.21.15.16:0/2068095165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86a8103b60 0x7f86a8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.721+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 >> 172.21.15.16:0/2068095165 conn(0x7f86a807b850 msgr2=0x7f86a8107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.722+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 shutdown_connections 2024-09-21T00:45:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.722+0000 7f86af05b640 1 -- 172.21.15.16:0/2068095165 wait complete. 2024-09-21T00:45:14.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 -- 172.21.15.16:0/1558965552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec1083b0 msgr2=0x7fe4ec1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 --2- 172.21.15.16:0/1558965552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec1087c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009900 tx=0x7fe4dc02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 -- 172.21.15.16:0/1558965552 shutdown_connections 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 --2- 172.21.15.16:0/1558965552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 0x7fe4ec10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 --2- 172.21.15.16:0/1558965552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec1087c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 --2- 172.21.15.16:0/1558965552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec102a70 0x7fe4ec102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.917+0000 7fe4f371d640 1 -- 172.21.15.16:0/1558965552 >> 172.21.15.16:0/1558965552 conn(0x7fe4ec079710 msgr2=0x7fe4ec079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 -- 172.21.15.16:0/1558965552 shutdown_connections 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 -- 172.21.15.16:0/1558965552 wait complete. 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 Processor -- start 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 -- start start 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.918+0000 7fe4f371d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 0x7fe4ec19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec1129c0 con 0x7fe4ec102a70 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec112840 con 0x7fe4ec1083b0 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec112b40 con 0x7fe4ec108d00 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59876/0 (socket says 172.21.15.16:59876) 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 -- 172.21.15.16:0/3026813630 learned_addr learned my addr 172.21.15.16:0/3026813630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f1cba640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 0x7fe4ec19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f0cb8640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 -- 172.21.15.16:0/3026813630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 msgr2=0x7fe4ec19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 0x7fe4ec19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 -- 172.21.15.16:0/3026813630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 msgr2=0x7fe4ec199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 -- 172.21.15.16:0/3026813630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec19f320 con 0x7fe4ec102a70 2024-09-21T00:45:14.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f0cb8640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f14b9640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c890 tx=0x7fe4e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8004220 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4e80043c0 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec19f610 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8004a00 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.919+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec1a5d70 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.920+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec103cf0 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.922+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe4e80079b0 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.923+0000 7fe4e27fc640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 0x7fe4d80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.923+0000 7fe4f0cb8640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 0x7fe4d80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.923+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe4e80e7620 con 0x7fe4ec102a70 2024-09-21T00:45:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.924+0000 7fe4f0cb8640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 0x7fe4d80b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009230 tx=0x7fe4dc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:14.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:14.927+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4e8014030 con 0x7fe4ec102a70 2024-09-21T00:45:15.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:14 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3302262804' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:45:15.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:14 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3302262804' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:45:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.117+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe4ec102e80 con 0x7fe4ec102a70 2024-09-21T00:45:15.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.117+0000 7fe4e27fc640 1 -- 172.21.15.16:0/3026813630 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe4e80add40 con 0x7fe4ec102a70 2024-09-21T00:45:15.119 INFO:teuthology.orchestra.run.smithi016.stdout:120259084349 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 msgr2=0x7fe4d80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 0x7fe4d80b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009230 tx=0x7fe4dc000bc0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 msgr2=0x7fe4ec1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c890 tx=0x7fe4e800cd50 comp rx=0 tx=0).stop 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 shutdown_connections 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe4d80b65a0 0x7fe4d80b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec108d00 0x7fe4ec19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4ec1083b0 0x7fe4ec199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 --2- 172.21.15.16:0/3026813630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4ec102a70 0x7fe4ec1993b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 >> 172.21.15.16:0/3026813630 conn(0x7fe4ec079710 msgr2=0x7fe4ec106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:15.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 shutdown_connections 2024-09-21T00:45:15.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:15.120+0000 7fe4f371d640 1 -- 172.21.15.16:0/3026813630 wait complete. 2024-09-21T00:45:15.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.599+0000 7fa0ee375640 1 -- 172.21.15.16:0/3426975916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e81083a0 msgr2=0x7fa0e81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.599+0000 7fa0ee375640 1 --2- 172.21.15.16:0/3426975916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e81083a0 0x7fa0e81087b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009900 tx=0x7fa0d002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:15.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 -- 172.21.15.16:0/3426975916 shutdown_connections 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 --2- 172.21.15.16:0/3426975916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8108cf0 0x7fa0e810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 --2- 172.21.15.16:0/3426975916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e81083a0 0x7fa0e81087b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 --2- 172.21.15.16:0/3426975916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e8102a60 0x7fa0e8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 -- 172.21.15.16:0/3426975916 >> 172.21.15.16:0/3426975916 conn(0x7fa0e8079760 msgr2=0x7fa0e8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 -- 172.21.15.16:0/3426975916 shutdown_connections 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 -- 172.21.15.16:0/3426975916 wait complete. 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 Processor -- start 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.600+0000 7fa0ee375640 1 -- start start 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 0x7fa0e819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e81083a0 0x7fa0e819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8113ad0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8113950 con 0x7fa0e81083a0 2024-09-21T00:45:15.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ee375640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8113c50 con 0x7fa0e8102a60 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0e7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 0x7fa0e819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47768/0 (socket says 172.21.15.16:47768) 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 -- 172.21.15.16:0/1256102869 learned_addr learned my addr 172.21.15.16:0/1256102869 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0dffff640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e81083a0 0x7fa0e819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stdout:98784247872 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 -- 172.21.15.16:0/1256102869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 msgr2=0x7fa0e819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 0x7fa0e819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 -- 172.21.15.16:0/1256102869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e81083a0 msgr2=0x7fa0e819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e81083a0 0x7fa0e819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 -- 172.21.15.16:0/1256102869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81a0450 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0e7fff640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 0x7fa0e819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0ec912640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000eb10 tx=0x7fa0e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0004b20 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0e0004cc0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.601+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0010670 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.602+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e81a0740 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.602+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e81a6ea0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.603+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e8103ce0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.604+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa0e0005020 con 0x7fa0e8108cf0 2024-09-21T00:45:15.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.605+0000 7fa0e5ffb640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 0x7fa0d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.606+0000 7fa0e7fff640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 0x7fa0d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.606+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa0e00e7a80 con 0x7fa0e8108cf0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.606+0000 7fa0e7fff640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 0x7fa0d40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009fc0 tx=0x7fa0d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.609+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0e00e9e20 con 0x7fa0e8108cf0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.820+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa0e810aac0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.821+0000 7fa0e5ffb640 1 -- 172.21.15.16:0/1256102869 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0e00ae1a0 con 0x7fa0e8108cf0 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 msgr2=0x7fa0d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 0x7fa0d40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009fc0 tx=0x7fa0d8005f90 comp rx=0 tx=0).stop 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 msgr2=0x7fa0e819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000eb10 tx=0x7fa0e000c2d0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 shutdown_connections 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa0d40b65a0 0x7fa0d40b8ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0e8108cf0 0x7fa0e819fd20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0e81083a0 0x7fa0e819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 --2- 172.21.15.16:0/1256102869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0e8102a60 0x7fa0e819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:15.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 >> 172.21.15.16:0/1256102869 conn(0x7fa0e8079760 msgr2=0x7fa0e81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:15.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 shutdown_connections 2024-09-21T00:45:15.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:12.823+0000 7fa0ee375640 1 -- 172.21.15.16:0/1256102869 wait complete. 2024-09-21T00:45:15.849 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:15 smithi016 ceph-mon[30947]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:15.849 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:15 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2068095165' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:45:15.849 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:15 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3026813630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:45:15.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247871 got 98784247872 for osd.3 2024-09-21T00:45:15.884 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:15 smithi123 ceph-mon[34853]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:15 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2068095165' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:45:16.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:15 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3026813630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:45:16.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:15 smithi178 ceph-mon[34888]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:16.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:15 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2068095165' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:45:16.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:15 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3026813630' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:45:16.640 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574924 for osd.1 2024-09-21T00:45:16.641 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:16.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 -- 172.21.15.16:0/2614451891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 msgr2=0x7f574c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 --2- 172.21.15.16:0/2614451891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c10d8c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5738009900 tx=0x7f573802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 -- 172.21.15.16:0/2614451891 shutdown_connections 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 --2- 172.21.15.16:0/2614451891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 --2- 172.21.15.16:0/2614451891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c10d8c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 --2- 172.21.15.16:0/2614451891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 -- 172.21.15.16:0/2614451891 >> 172.21.15.16:0/2614451891 conn(0x7f574c079730 msgr2=0x7f574c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 -- 172.21.15.16:0/2614451891 shutdown_connections 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.848+0000 7f575314d640 1 -- 172.21.15.16:0/2614451891 wait complete. 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 Processor -- start 2024-09-21T00:45:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 -- start start 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c1031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f574c113ac0 con 0x7f574c105280 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f574c113940 con 0x7f574c104850 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f575314d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f574c113c40 con 0x7f574c10de00 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f574bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f5750ee9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f574bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59886/0 (socket says 172.21.15.16:59886) 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f574bfff640 1 -- 172.21.15.16:0/1994662189 learned_addr learned my addr 172.21.15.16:0/1994662189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f5750ee9640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:52936/0 (socket says 172.21.15.16:52936) 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.849+0000 7f57516ea640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c1031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 -- 172.21.15.16:0/1994662189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 msgr2=0x7f574c1031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c1031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 -- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 msgr2=0x7f574c102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 -- 172.21.15.16:0/1994662189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c1a87b0 con 0x7f574c104850 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f574bfff640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f57516ea640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5750ee9640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f574000d6a0 tx=0x7f574000db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740017070 con 0x7f574c104850 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c1a8aa0 con 0x7f574c104850 2024-09-21T00:45:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5740009cd0 con 0x7f574c104850 2024-09-21T00:45:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740003b60 con 0x7f574c104850 2024-09-21T00:45:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.850+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c1a9030 con 0x7f574c104850 2024-09-21T00:45:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.851+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574c06c180 con 0x7f574c104850 2024-09-21T00:45:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.853+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f57400042b0 con 0x7f574c104850 2024-09-21T00:45:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.854+0000 7f5749ffb640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 0x7f573c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.854+0000 7f574bfff640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 0x7f573c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.854+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f57400e7260 con 0x7f574c104850 2024-09-21T00:45:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.854+0000 7f574bfff640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 0x7f573c0b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f574c102330 tx=0x7f5738032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:16.857+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57400ad980 con 0x7f574c104850 2024-09-21T00:45:17.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.075+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f574c103a60 con 0x7f574c104850 2024-09-21T00:45:17.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.075+0000 7f5749ffb640 1 -- 172.21.15.16:0/1994662189 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f57400b1d60 con 0x7f574c104850 2024-09-21T00:45:17.076 INFO:teuthology.orchestra.run.smithi016.stdout:240518168612 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 msgr2=0x7f573c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 0x7f573c0b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f574c102330 tx=0x7f5738032ed0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 msgr2=0x7f574c102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f574000d6a0 tx=0x7f574000db60 comp rx=0 tx=0).stop 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 shutdown_connections 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.077+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f573c0b65a0 0x7f573c0b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f574c10de00 0x7f574c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c105280 0x7f574c102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 --2- 172.21.15.16:0/1994662189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f574c104850 0x7f574c102760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 >> 172.21.15.16:0/1994662189 conn(0x7f574c079730 msgr2=0x7f574c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 shutdown_connections 2024-09-21T00:45:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.078+0000 7f575314d640 1 -- 172.21.15.16:0/1994662189 wait complete. 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.051+0000 7f9400711640 1 -- 172.21.15.16:0/4219923814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81052d0 msgr2=0x7f93f810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.051+0000 7f9400711640 1 --2- 172.21.15.16:0/4219923814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81052d0 0x7f93f810d910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009900 tx=0x7f93e802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 -- 172.21.15.16:0/4219923814 shutdown_connections 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 --2- 172.21.15.16:0/4219923814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f810de50 0x7f93f81102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 --2- 172.21.15.16:0/4219923814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81052d0 0x7f93f810d910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 --2- 172.21.15.16:0/4219923814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f81048a0 0x7f93f8104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 -- 172.21.15.16:0/4219923814 >> 172.21.15.16:0/4219923814 conn(0x7f93f8079730 msgr2=0x7f93f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 -- 172.21.15.16:0/4219923814 shutdown_connections 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 -- 172.21.15.16:0/4219923814 wait complete. 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.052+0000 7f9400711640 1 Processor -- start 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 -- start start 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f81052d0 0x7f93f8102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 0x7f93f8103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8113a60 con 0x7f93f81048a0 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81138e0 con 0x7f93f81052d0 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f9400711640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8113be0 con 0x7f93f810de50 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f93fe4ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f93fe4ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59890/0 (socket says 172.21.15.16:59890) 2024-09-21T00:45:17.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f93fe4ad640 1 -- 172.21.15.16:0/1727231680 learned_addr learned my addr 172.21.15.16:0/1727231680 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f93fdcac640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f81052d0 0x7f93f8102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.053+0000 7f93fecae640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 0x7f93f8103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 -- 172.21.15.16:0/1727231680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 msgr2=0x7f93f8103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 0x7f93f8103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 -- 172.21.15.16:0/1727231680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f81052d0 msgr2=0x7f93f8102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f81052d0 0x7f93f8102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 -- 172.21.15.16:0/1727231680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f81a8750 con 0x7f93f81048a0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fecae640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 0x7f93f8103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93fe4ad640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9c0 tx=0x7f93f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f400cd80 con 0x7f93f81048a0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f81a8a40 con 0x7f93f81048a0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f40035f0 con 0x7f93f81048a0 2024-09-21T00:45:17.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4010690 con 0x7f93f81048a0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.054+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81a8f50 con 0x7f93f81048a0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.056+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f8104cb0 con 0x7f93f81048a0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.057+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f93f4004000 con 0x7f93f81048a0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.058+0000 7f93ef7fe640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 0x7f93e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.058+0000 7f93fdcac640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 0x7f93e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.058+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f93f40e7990 con 0x7f93f81048a0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.059+0000 7f93fdcac640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 0x7f93e40b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000c00 tx=0x7f93e8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.063+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93f40ae1b0 con 0x7f93f81048a0 2024-09-21T00:45:17.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.272+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f93f81a9270 con 0x7f93f81048a0 2024-09-21T00:45:17.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.272+0000 7f93ef7fe640 1 -- 172.21.15.16:0/1727231680 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f93f40a9070 con 0x7f93f81048a0 2024-09-21T00:45:17.273 INFO:teuthology.orchestra.run.smithi016.stdout:214748364841 2024-09-21T00:45:17.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 msgr2=0x7f93e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 0x7f93e40b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000c00 tx=0x7f93e8031400 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 msgr2=0x7f93f81027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9c0 tx=0x7f93f400ee80 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 shutdown_connections 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93e40b65a0 0x7f93e40b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f810de50 0x7f93f8103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93f81052d0 0x7f93f8102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 --2- 172.21.15.16:0/1727231680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93f81048a0 0x7f93f81027b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.274+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 >> 172.21.15.16:0/1727231680 conn(0x7f93f8079730 msgr2=0x7f93f81068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.275+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 shutdown_connections 2024-09-21T00:45:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:17.275+0000 7f9400711640 1 -- 172.21.15.16:0/1727231680 wait complete. 2024-09-21T00:45:17.980 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:17 smithi016 ceph-mon[30947]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T00:45:17.980 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1994662189' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:45:17.980 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1727231680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:45:18.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364838 got 214748364841 for osd.8 2024-09-21T00:45:18.018 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:17 smithi123 ceph-mon[34853]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T00:45:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:17 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1994662189' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:45:18.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:17 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1727231680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:45:18.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:17 smithi178 ceph-mon[34888]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-21T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:17 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1994662189' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:45:18.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:17 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1727231680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:45:18.394 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168609 got 240518168612 for osd.9 2024-09-21T00:45:18.394 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:18.803 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920819 got 141733920822 for osd.5 2024-09-21T00:45:18.803 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:19.385 INFO:teuthology.orchestra.run.smithi016.stdout:188978561068 2024-09-21T00:45:19.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T00:45:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:19.456 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:19.687 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:19 smithi016 ceph-mon[30947]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:45:19.947 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084347 got 120259084349 for osd.4 2024-09-21T00:45:19.948 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:20.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:19 smithi123 ceph-mon[34853]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:45:20.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:19 smithi178 ceph-mon[34888]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.428+0000 7fe09797e640 1 -- 172.21.15.16:0/667415191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 msgr2=0x7fe0901098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.428+0000 7fe09797e640 1 --2- 172.21.15.16:0/667415191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe0901098b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe080009900 tx=0x7fe08002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 -- 172.21.15.16:0/667415191 shutdown_connections 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 --2- 172.21.15.16:0/667415191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090109df0 0x7fe090110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 --2- 172.21.15.16:0/667415191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe0901098b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 --2- 172.21.15.16:0/667415191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090103b60 0x7fe090103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 -- 172.21.15.16:0/667415191 >> 172.21.15.16:0/667415191 conn(0x7fe09007b850 msgr2=0x7fe09007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 -- 172.21.15.16:0/667415191 shutdown_connections 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.429+0000 7fe09797e640 1 -- 172.21.15.16:0/667415191 wait complete. 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 Processor -- start 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 -- start start 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090103b60 0x7fe09019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090109df0 0x7fe0901a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe090113af0 con 0x7fe0901094a0 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe090113970 con 0x7fe090103b60 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09797e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe090113c70 con 0x7fe090109df0 2024-09-21T00:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe094f19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe094f19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59908/0 (socket says 172.21.15.16:59908) 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe094f19640 1 -- 172.21.15.16:0/1835969955 learned_addr learned my addr 172.21.15.16:0/1835969955 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe09571a640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090103b60 0x7fe09019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.430+0000 7fe095f1b640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090109df0 0x7fe0901a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 -- 172.21.15.16:0/1835969955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090109df0 msgr2=0x7fe0901a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090109df0 0x7fe0901a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 -- 172.21.15.16:0/1835969955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090103b60 msgr2=0x7fe09019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090103b60 0x7fe09019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 -- 172.21.15.16:0/1835969955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0901a2690 con 0x7fe0901094a0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe094f19640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe08002a930 tx=0x7fe080004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08003f030 con 0x7fe0901094a0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0901a2920 con 0x7fe0901094a0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe080003cb0 con 0x7fe0901094a0 2024-09-21T00:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080035070 con 0x7fe0901094a0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.431+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0901a90e0 con 0x7fe0901094a0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.432+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe090103f70 con 0x7fe0901094a0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.434+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe080042030 con 0x7fe0901094a0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.434+0000 7fe0867fc640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 0x7fe07c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.434+0000 7fe09571a640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 0x7fe07c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.435+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe080107de0 con 0x7fe0901094a0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.435+0000 7fe09571a640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 0x7fe07c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0058c0 tx=0x7fe08c00a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.438+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0800ce600 con 0x7fe0901094a0 2024-09-21T00:45:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.635+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe0901a9340 con 0x7fe0901094a0 2024-09-21T00:45:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.635+0000 7fe0867fc640 1 -- 172.21.15.16:0/1835969955 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe0800d29e0 con 0x7fe0901094a0 2024-09-21T00:45:20.636 INFO:teuthology.orchestra.run.smithi016.stdout:287762808857 2024-09-21T00:45:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.637+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 msgr2=0x7fe07c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.637+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 0x7fe07c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0058c0 tx=0x7fe08c00a250 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.637+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 msgr2=0x7fe09019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.637+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe08002a930 tx=0x7fe080004270 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 shutdown_connections 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe07c0b65a0 0x7fe07c0b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe090109df0 0x7fe0901a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0901094a0 0x7fe09019ccc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 --2- 172.21.15.16:0/1835969955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe090103b60 0x7fe09019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 >> 172.21.15.16:0/1835969955 conn(0x7fe09007b850 msgr2=0x7fe090105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 shutdown_connections 2024-09-21T00:45:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:20.638+0000 7fe09797e640 1 -- 172.21.15.16:0/1835969955 wait complete. 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.064+0000 7f937334e640 1 -- 172.21.15.16:0/2568530798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c10de60 msgr2=0x7f936c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 --2- 172.21.15.16:0/2568530798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c10de60 0x7f936c110330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9364009ca0 tx=0x7f936402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 -- 172.21.15.16:0/2568530798 shutdown_connections 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 --2- 172.21.15.16:0/2568530798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c10de60 0x7f936c110330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 --2- 172.21.15.16:0/2568530798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c105380 0x7f936c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 --2- 172.21.15.16:0/2568530798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c104a30 0x7f936c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 -- 172.21.15.16:0/2568530798 >> 172.21.15.16:0/2568530798 conn(0x7f936c079760 msgr2=0x7f936c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:21.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 -- 172.21.15.16:0/2568530798 shutdown_connections 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 -- 172.21.15.16:0/2568530798 wait complete. 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.065+0000 7f937334e640 1 Processor -- start 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 -- start start 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c104a30 0x7f936c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c10de60 0x7f936c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f936c113aa0 con 0x7f936c105380 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f936c113920 con 0x7f936c10de60 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f937334e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f936c113c20 con 0x7f936c104a30 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59932/0 (socket says 172.21.15.16:59932) 2024-09-21T00:45:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 -- 172.21.15.16:0/3190868526 learned_addr learned my addr 172.21.15.16:0/3190868526 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93710ea640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c104a30 0x7f936c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93718eb640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c10de60 0x7f936c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 -- 172.21.15.16:0/3190868526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c104a30 msgr2=0x7f936c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c104a30 0x7f936c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 -- 172.21.15.16:0/3190868526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c10de60 msgr2=0x7f936c19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c10de60 0x7f936c19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.066+0000 7f93708e9640 1 -- 172.21.15.16:0/3190868526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c1a02c0 con 0x7f936c105380 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f93708e9640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c8c0 tx=0x7f935c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c007bb0 con 0x7f936c105380 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f935c007d50 con 0x7f936c105380 2024-09-21T00:45:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c0187c0 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c1a05b0 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.067+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c1a6dd0 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.068+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936c06c1f0 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.070+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f935c00fa20 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.070+0000 7f93627fc640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 0x7f93580b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.071+0000 7f93710ea640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 0x7f93580b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.071+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f935c0e7640 con 0x7f936c105380 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.071+0000 7f93710ea640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 0x7f93580b8b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f936c06c8f0 tx=0x7f936800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.074+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f935c014030 con 0x7f936c105380 2024-09-21T00:45:21.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.266+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f936c1a7080 con 0x7f936c105380 2024-09-21T00:45:21.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.267+0000 7f93627fc640 1 -- 172.21.15.16:0/3190868526 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f935c0adf70 con 0x7f936c105380 2024-09-21T00:45:21.268 INFO:teuthology.orchestra.run.smithi016.stdout:261993005086 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 msgr2=0x7f93580b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 0x7f93580b8b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f936c06c8f0 tx=0x7f936800b390 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 msgr2=0x7f936c19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c8c0 tx=0x7f935c00cd80 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 shutdown_connections 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93580b6650 0x7f93580b8b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c10de60 0x7f936c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f936c105380 0x7f936c19a9b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 --2- 172.21.15.16:0/3190868526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f936c104a30 0x7f936c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:21.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 >> 172.21.15.16:0/3190868526 conn(0x7f936c079760 msgr2=0x7f936c107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:21.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 shutdown_connections 2024-09-21T00:45:21.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:21.269+0000 7f937334e640 1 -- 172.21.15.16:0/3190868526 wait complete. 2024-09-21T00:45:21.596 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808854 got 287762808857 for osd.11 2024-09-21T00:45:21.597 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:21 smithi016 ceph-mon[30947]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:22.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1835969955' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:45:22.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3190868526' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:45:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:21 smithi123 ceph-mon[34853]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1835969955' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:45:22.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3190868526' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:45:22.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:21 smithi178 ceph-mon[34888]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:22.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1835969955' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:45:22.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3190868526' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:45:22.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 -- 172.21.15.16:0/2466831844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c041083d0 msgr2=0x7f5c041087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2466831844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c041083d0 0x7f5c041087e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009900 tx=0x7f5bf802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 -- 172.21.15.16:0/2466831844 shutdown_connections 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2466831844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c04108d20 0x7f5c0410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2466831844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c041083d0 0x7f5c041087e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2466831844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 0x7f5c04102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.119+0000 7f5c0a692640 1 -- 172.21.15.16:0/2466831844 >> 172.21.15.16:0/2466831844 conn(0x7f5c04079760 msgr2=0x7f5c04079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.120+0000 7f5c0a692640 1 -- 172.21.15.16:0/2466831844 shutdown_connections 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.120+0000 7f5c0a692640 1 -- 172.21.15.16:0/2466831844 wait complete. 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.120+0000 7f5c0a692640 1 Processor -- start 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.120+0000 7f5c0a692640 1 -- start start 2024-09-21T00:45:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 0x7f5c0419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 0x7f5c0419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04112990 con 0x7f5c04108d20 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04112810 con 0x7f5c041083d0 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c0a692640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04112b10 con 0x7f5c04102ae0 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59948/0 (socket says 172.21.15.16:59948) 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 -- 172.21.15.16:0/2189943651 learned_addr learned my addr 172.21.15.16:0/2189943651 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c03fff640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 0x7f5c0419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c037fe640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 0x7f5c0419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 -- 172.21.15.16:0/2189943651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 msgr2=0x7f5c0419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 0x7f5c0419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 -- 172.21.15.16:0/2189943651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 msgr2=0x7f5c0419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 0x7f5c0419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 -- 172.21.15.16:0/2189943651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041a0420 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c037fe640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 0x7f5c0419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.121+0000 7f5c08c2f640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00eb10 tx=0x7f5bfc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.122+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc004b20 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.122+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bfc004cc0 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.122+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041a0710 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.122+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc010670 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.122+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a6e70 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.123+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c04103d10 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.124+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5bfc005020 con 0x7f5c04108d20 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.125+0000 7f5c017fa640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 0x7f5bec0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.125+0000 7f5c03fff640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 0x7f5bec0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.125+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5bfc0e79b0 con 0x7f5c04108d20 2024-09-21T00:45:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.126+0000 7f5c03fff640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 0x7f5bec0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005fd0 tx=0x7f5bf400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:22.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.130+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bfc0ae1d0 con 0x7f5c04108d20 2024-09-21T00:45:22.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.330+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5c0410b590 con 0x7f5c04108d20 2024-09-21T00:45:22.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.330+0000 7f5c017fa640 1 -- 172.21.15.16:0/2189943651 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5bfc0b25b0 con 0x7f5c04108d20 2024-09-21T00:45:22.332 INFO:teuthology.orchestra.run.smithi016.stdout:167503724596 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 msgr2=0x7f5bec0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 0x7f5bec0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005fd0 tx=0x7f5bf400b390 comp rx=0 tx=0).stop 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 msgr2=0x7f5c0419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00eb10 tx=0x7f5bfc00c2d0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 shutdown_connections 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5bec0b6620 0x7f5bec0b8b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c04108d20 0x7f5c0419fcf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c041083d0 0x7f5c0419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 --2- 172.21.15.16:0/2189943651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04102ae0 0x7f5c0419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:22.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 >> 172.21.15.16:0/2189943651 conn(0x7f5c04079760 msgr2=0x7f5c04101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:22.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 shutdown_connections 2024-09-21T00:45:22.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:22.333+0000 7f5c0a692640 1 -- 172.21.15.16:0/2189943651 wait complete. 2024-09-21T00:45:22.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005082 got 261993005086 for osd.10 2024-09-21T00:45:22.631 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:22.874 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2189943651' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:45:23.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:22 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2189943651' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:45:23.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:22 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2189943651' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:45:23.483 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724592 got 167503724596 for osd.6 2024-09-21T00:45:23.483 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:23.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:23 smithi016 ceph-mon[30947]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:23.928 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:24.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:23 smithi123 ceph-mon[34853]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:24.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:23 smithi178 ceph-mon[34888]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:24.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 -- 172.21.15.16:0/2077271815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8904105380 msgr2=0x7f890410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:24.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 --2- 172.21.15.16:0/2077271815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8904105380 0x7f890410d8d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009900 tx=0x7f88f802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:24.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 -- 172.21.15.16:0/2077271815 shutdown_connections 2024-09-21T00:45:24.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 --2- 172.21.15.16:0/2077271815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890410de60 0x7f8904110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 --2- 172.21.15.16:0/2077271815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8904105380 0x7f890410d8d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 --2- 172.21.15.16:0/2077271815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 0x7f8904104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 -- 172.21.15.16:0/2077271815 >> 172.21.15.16:0/2077271815 conn(0x7f8904079760 msgr2=0x7f8904079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 -- 172.21.15.16:0/2077271815 shutdown_connections 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.403+0000 7f89089b2640 1 -- 172.21.15.16:0/2077271815 wait complete. 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 Processor -- start 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 -- start start 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 0x7f890419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8904105380 0x7f890419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8904113ae0 con 0x7f890410de60 2024-09-21T00:45:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8904113960 con 0x7f8904105380 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f89089b2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8904113c60 con 0x7f8904104a30 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f8902d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f8902d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52666/0 (socket says 172.21.15.16:52666) 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f8902d9d640 1 -- 172.21.15.16:0/1802593197 learned_addr learned my addr 172.21.15.16:0/1802593197 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.404+0000 7f8901d9b640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8904105380 0x7f890419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f890259c640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 0x7f890419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 -- 172.21.15.16:0/1802593197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 msgr2=0x7f890419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 0x7f890419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 -- 172.21.15.16:0/1802593197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8904105380 msgr2=0x7f890419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8904105380 0x7f890419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 -- 172.21.15.16:0/1802593197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89041a04c0 con 0x7f890410de60 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f8902d9d640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009fd0 tx=0x7f88fc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc011830 con 0x7f890410de60 2024-09-21T00:45:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88fc016070 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89041a07b0 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc010de0 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.405+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89041a6f10 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.406+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890406c1f0 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.408+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f88fc0119d0 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.408+0000 7f88f37fe640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 0x7f88ec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.409+0000 7f890259c640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 0x7f88ec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.409+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f88fc0e70c0 con 0x7f890410de60 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.409+0000 7f890259c640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 0x7f88ec0b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a300 tx=0x7f88f400a290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.412+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88fc0ad7e0 con 0x7f890410de60 2024-09-21T00:45:24.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.609+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8904104e40 con 0x7f890410de60 2024-09-21T00:45:24.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.609+0000 7f88f37fe640 1 -- 172.21.15.16:0/1802593197 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8904104e40 con 0x7f890410de60 2024-09-21T00:45:24.610 INFO:teuthology.orchestra.run.smithi016.stdout:188978561070 2024-09-21T00:45:24.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.611+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 msgr2=0x7f88ec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.611+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 0x7f88ec0b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a300 tx=0x7f88f400a290 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 msgr2=0x7f890419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009fd0 tx=0x7f88fc00b8e0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 shutdown_connections 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f88ec0b65a0 0x7f88ec0b8ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890410de60 0x7f890419fd90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8904105380 0x7f890419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 --2- 172.21.15.16:0/1802593197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8904104a30 0x7f890419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 >> 172.21.15.16:0/1802593197 conn(0x7f8904079760 msgr2=0x7f89041008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 shutdown_connections 2024-09-21T00:45:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:24.612+0000 7f89089b2640 1 -- 172.21.15.16:0/1802593197 wait complete. 2024-09-21T00:45:25.290 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561068 got 188978561070 for osd.7 2024-09-21T00:45:25.290 DEBUG:teuthology.parallel:result is None 2024-09-21T00:45:25.290 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:45:25.290 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:45:25.586 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:25 smithi016 ceph-mon[30947]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:25 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1802593197' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:45:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:25 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:25 smithi123 ceph-mon[34853]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:25 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1802593197' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:45:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:25 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:25 smithi178 ceph-mon[34888]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:25 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1802593197' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:45:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:25 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- 172.21.15.16:0/1114552402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 msgr2=0x7fed30109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:26.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1114552402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed30109970 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed18009900 tx=0x7fed1802a3f0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- 172.21.15.16:0/1114552402 shutdown_connections 2024-09-21T00:45:26.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1114552402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 0x7fed301106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1114552402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed30109970 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1114552402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 0x7fed30102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- 172.21.15.16:0/1114552402 >> 172.21.15.16:0/1114552402 conn(0x7fed30079ec0 msgr2=0x7fed3007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- 172.21.15.16:0/1114552402 shutdown_connections 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- 172.21.15.16:0/1114552402 wait complete. 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 Processor -- start 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.062+0000 7fed35b3b640 1 -- start start 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 0x7fed3019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 0x7fed3019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113b70 con 0x7fed30109560 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed301139f0 con 0x7fed30102080 2024-09-21T00:45:26.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed35b3b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113cf0 con 0x7fed30109eb0 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52674/0 (socket says 172.21.15.16:52674) 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 -- 172.21.15.16:0/1035899657 learned_addr learned my addr 172.21.15.16:0/1035899657 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed2f7fe640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 0x7fed3019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed2ffff640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 0x7fed3019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 -- 172.21.15.16:0/1035899657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 msgr2=0x7fed3019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 0x7fed3019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 -- 172.21.15.16:0/1035899657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 msgr2=0x7fed3019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 0x7fed3019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 -- 172.21.15.16:0/1035899657 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed301a0490 con 0x7fed30109560 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.063+0000 7fed27fff640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed1802a910 tx=0x7fed18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.064+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1803f030 con 0x7fed30109560 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.064+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed18003aa0 con 0x7fed30109560 2024-09-21T00:45:26.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.064+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed301a0720 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.064+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18035070 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.064+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301a0c00 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.065+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed30102490 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.066+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fed18042030 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.067+0000 7fed2d7fa640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 0x7fed1c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.067+0000 7fed2f7fe640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 0x7fed1c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.068+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fed18107f30 con 0x7fed30109560 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.068+0000 7fed2f7fe640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 0x7fed1c0b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed2000bbe0 tx=0x7fed2000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:26.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.071+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed180ce6d0 con 0x7fed30109560 2024-09-21T00:45:26.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.255+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed3010bce0 con 0x7fed1c0b65d0 2024-09-21T00:45:26.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.260+0000 7fed2d7fa640 1 -- 172.21.15.16:0/1035899657 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258973 (secure 0 0 0) 0x7fed3010bce0 con 0x7fed1c0b65d0 2024-09-21T00:45:26.263 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:26.264 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 msgr2=0x7fed1c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 0x7fed1c0b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed2000bbe0 tx=0x7fed2000b390 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 msgr2=0x7fed3019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed1802a910 tx=0x7fed18004270 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 shutdown_connections 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fed1c0b65d0 0x7fed1c0b8ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed30109eb0 0x7fed3019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed30109560 0x7fed3019ab80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 --2- 172.21.15.16:0/1035899657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed30102080 0x7fed3019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:26.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 >> 172.21.15.16:0/1035899657 conn(0x7fed30079ec0 msgr2=0x7fed30105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:26.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 shutdown_connections 2024-09-21T00:45:26.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:26.263+0000 7fed35b3b640 1 -- 172.21.15.16:0/1035899657 wait complete. 2024-09-21T00:45:26.940 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:45:26.941 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:45:26.941 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:26.973 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T00:45:24.272139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662099,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":612,"num_read_kb":416,"num_write":371,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953401,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380328,"kb_used_data":10224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561496,"statfs":{"total":1151940427776,"available":1151550971904,"internally_reserved":0,"allocated":10469376,"data_stored":6768957,"data_compressed":114495,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003556"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800403+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:44:47.800403+0000","last_peered":"2024-09-21T00:44:47.800403+0000","last_clean":"2024-09-21T00:44:47.800403+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:44:47.800403+0000","last_undegraded":"2024-09-21T00:44:47.800403+0000","last_fullsized":"2024-09-21T00:44:47.800403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803042+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:44:47.803042+0000","last_peered":"2024-09-21T00:44:47.803042+0000","last_clean":"2024-09-21T00:44:47.803042+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:44:47.803042+0000","last_undegraded":"2024-09-21T00:44:47.803042+0000","last_fullsized":"2024-09-21T00:44:47.803042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803214+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:44:47.803214+0000","last_peered":"2024-09-21T00:44:47.803214+0000","last_clean":"2024-09-21T00:44:47.803214+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:44:47.803214+0000","last_undegraded":"2024-09-21T00:44:47.803214+0000","last_fullsized":"2024-09-21T00:44:47.803214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800798+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:44:47.800798+0000","last_peered":"2024-09-21T00:44:47.800798+0000","last_clean":"2024-09-21T00:44:47.800798+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:44:47.800798+0000","last_undegraded":"2024-09-21T00:44:47.800798+0000","last_fullsized":"2024-09-21T00:44:47.800798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799952+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:44:47.799952+0000","last_peered":"2024-09-21T00:44:47.799952+0000","last_clean":"2024-09-21T00:44:47.799952+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:44:47.799952+0000","last_undegraded":"2024-09-21T00:44:47.799952+0000","last_fullsized":"2024-09-21T00:44:47.799952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797804+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:44:47.797804+0000","last_peered":"2024-09-21T00:44:47.797804+0000","last_clean":"2024-09-21T00:44:47.797804+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:44:47.797804+0000","last_undegraded":"2024-09-21T00:44:47.797804+0000","last_fullsized":"2024-09-21T00:44:47.797804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798415+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:44:47.798415+0000","last_peered":"2024-09-21T00:44:47.798415+0000","last_clean":"2024-09-21T00:44:47.798415+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:44:47.798415+0000","last_undegraded":"2024-09-21T00:44:47.798415+0000","last_fullsized":"2024-09-21T00:44:47.798415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800636+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:44:47.800636+0000","last_peered":"2024-09-21T00:44:47.800636+0000","last_clean":"2024-09-21T00:44:47.800636+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:44:47.800636+0000","last_undegraded":"2024-09-21T00:44:47.800636+0000","last_fullsized":"2024-09-21T00:44:47.800636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844329+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:44:47.844329+0000","last_peered":"2024-09-21T00:44:47.844329+0000","last_clean":"2024-09-21T00:44:47.844329+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:44:47.844329+0000","last_undegraded":"2024-09-21T00:44:47.844329+0000","last_fullsized":"2024-09-21T00:44:47.844329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.805196+0000","last_change":"2024-09-21T00:44:47.805103+0000","last_active":"2024-09-21T00:44:47.805196+0000","last_peered":"2024-09-21T00:44:47.805196+0000","last_clean":"2024-09-21T00:44:47.805196+0000","last_became_active":"2024-09-21T00:44:47.804708+0000","last_became_peered":"2024-09-21T00:44:47.804708+0000","last_unstale":"2024-09-21T00:44:47.805196+0000","last_undegraded":"2024-09-21T00:44:47.805196+0000","last_fullsized":"2024-09-21T00:44:47.805196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:18.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798953+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:44:47.798953+0000","last_peered":"2024-09-21T00:44:47.798953+0000","last_clean":"2024-09-21T00:44:47.798953+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:44:47.798953+0000","last_undegraded":"2024-09-21T00:44:47.798953+0000","last_fullsized":"2024-09-21T00:44:47.798953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800954+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:44:47.800954+0000","last_peered":"2024-09-21T00:44:47.800954+0000","last_clean":"2024-09-21T00:44:47.800954+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:44:47.800954+0000","last_undegraded":"2024-09-21T00:44:47.800954+0000","last_fullsized":"2024-09-21T00:44:47.800954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799799+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:44:47.799799+0000","last_peered":"2024-09-21T00:44:47.799799+0000","last_clean":"2024-09-21T00:44:47.799799+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:44:47.799799+0000","last_undegraded":"2024-09-21T00:44:47.799799+0000","last_fullsized":"2024-09-21T00:44:47.799799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803430+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:44:47.803430+0000","last_peered":"2024-09-21T00:44:47.803430+0000","last_clean":"2024-09-21T00:44:47.803430+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:44:47.803430+0000","last_undegraded":"2024-09-21T00:44:47.803430+0000","last_fullsized":"2024-09-21T00:44:47.803430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.802939+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:44:47.802939+0000","last_peered":"2024-09-21T00:44:47.802939+0000","last_clean":"2024-09-21T00:44:47.802939+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:44:47.802939+0000","last_undegraded":"2024-09-21T00:44:47.802939+0000","last_fullsized":"2024-09-21T00:44:47.802939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843720+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:44:47.843720+0000","last_peered":"2024-09-21T00:44:47.843720+0000","last_clean":"2024-09-21T00:44:47.843720+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:44:47.843720+0000","last_undegraded":"2024-09-21T00:44:47.843720+0000","last_fullsized":"2024-09-21T00:44:47.843720+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800531+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:44:47.800531+0000","last_peered":"2024-09-21T00:44:47.800531+0000","last_clean":"2024-09-21T00:44:47.800531+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:44:47.800531+0000","last_undegraded":"2024-09-21T00:44:47.800531+0000","last_fullsized":"2024-09-21T00:44:47.800531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796628+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:44:47.796628+0000","last_peered":"2024-09-21T00:44:47.796628+0000","last_clean":"2024-09-21T00:44:47.796628+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:44:47.796628+0000","last_undegraded":"2024-09-21T00:44:47.796628+0000","last_fullsized":"2024-09-21T00:44:47.796628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803375+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:44:47.803375+0000","last_peered":"2024-09-21T00:44:47.803375+0000","last_clean":"2024-09-21T00:44:47.803375+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:44:47.803375+0000","last_undegraded":"2024-09-21T00:44:47.803375+0000","last_fullsized":"2024-09-21T00:44:47.803375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799221+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:44:47.799221+0000","last_peered":"2024-09-21T00:44:47.799221+0000","last_clean":"2024-09-21T00:44:47.799221+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:44:47.799221+0000","last_undegraded":"2024-09-21T00:44:47.799221+0000","last_fullsized":"2024-09-21T00:44:47.799221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799907+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:44:47.799907+0000","last_peered":"2024-09-21T00:44:47.799907+0000","last_clean":"2024-09-21T00:44:47.799907+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:44:47.799907+0000","last_undegraded":"2024-09-21T00:44:47.799907+0000","last_fullsized":"2024-09-21T00:44:47.799907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843912+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:44:47.843912+0000","last_peered":"2024-09-21T00:44:47.843912+0000","last_clean":"2024-09-21T00:44:47.843912+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:44:47.843912+0000","last_undegraded":"2024-09-21T00:44:47.843912+0000","last_fullsized":"2024-09-21T00:44:47.843912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800859+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:44:47.800859+0000","last_peered":"2024-09-21T00:44:47.800859+0000","last_clean":"2024-09-21T00:44:47.800859+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:44:47.800859+0000","last_undegraded":"2024-09-21T00:44:47.800859+0000","last_fullsized":"2024-09-21T00:44:47.800859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803279+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:44:47.803279+0000","last_peered":"2024-09-21T00:44:47.803279+0000","last_clean":"2024-09-21T00:44:47.803279+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:44:47.803279+0000","last_undegraded":"2024-09-21T00:44:47.803279+0000","last_fullsized":"2024-09-21T00:44:47.803279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801318+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:44:47.801318+0000","last_peered":"2024-09-21T00:44:47.801318+0000","last_clean":"2024-09-21T00:44:47.801318+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:44:47.801318+0000","last_undegraded":"2024-09-21T00:44:47.801318+0000","last_fullsized":"2024-09-21T00:44:47.801318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803586+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:44:47.803586+0000","last_peered":"2024-09-21T00:44:47.803586+0000","last_clean":"2024-09-21T00:44:47.803586+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:44:47.803586+0000","last_undegraded":"2024-09-21T00:44:47.803586+0000","last_fullsized":"2024-09-21T00:44:47.803586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799588+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:44:47.799588+0000","last_peered":"2024-09-21T00:44:47.799588+0000","last_clean":"2024-09-21T00:44:47.799588+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:44:47.799588+0000","last_undegraded":"2024-09-21T00:44:47.799588+0000","last_fullsized":"2024-09-21T00:44:47.799588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800089+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:44:47.800089+0000","last_peered":"2024-09-21T00:44:47.800089+0000","last_clean":"2024-09-21T00:44:47.800089+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:44:47.800089+0000","last_undegraded":"2024-09-21T00:44:47.800089+0000","last_fullsized":"2024-09-21T00:44:47.800089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803321+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:44:47.803321+0000","last_peered":"2024-09-21T00:44:47.803321+0000","last_clean":"2024-09-21T00:44:47.803321+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:44:47.803321+0000","last_undegraded":"2024-09-21T00:44:47.803321+0000","last_fullsized":"2024-09-21T00:44:47.803321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803333+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:44:47.803333+0000","last_peered":"2024-09-21T00:44:47.803333+0000","last_clean":"2024-09-21T00:44:47.803333+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:44:47.803333+0000","last_undegraded":"2024-09-21T00:44:47.803333+0000","last_fullsized":"2024-09-21T00:44:47.803333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803872+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:44:47.803872+0000","last_peered":"2024-09-21T00:44:47.803872+0000","last_clean":"2024-09-21T00:44:47.803872+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:44:47.803872+0000","last_undegraded":"2024-09-21T00:44:47.803872+0000","last_fullsized":"2024-09-21T00:44:47.803872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800208+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:44:47.800208+0000","last_peered":"2024-09-21T00:44:47.800208+0000","last_clean":"2024-09-21T00:44:47.800208+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:44:47.800208+0000","last_undegraded":"2024-09-21T00:44:47.800208+0000","last_fullsized":"2024-09-21T00:44:47.800208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799578+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:44:47.799578+0000","last_peered":"2024-09-21T00:44:47.799578+0000","last_clean":"2024-09-21T00:44:47.799578+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:44:47.799578+0000","last_undegraded":"2024-09-21T00:44:47.799578+0000","last_fullsized":"2024-09-21T00:44:47.799578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:21.839583+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:45:21.839583+0000","last_peered":"2024-09-21T00:45:21.839583+0000","last_clean":"2024-09-21T00:45:21.839583+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:45:21.839583+0000","last_undegraded":"2024-09-21T00:45:21.839583+0000","last_fullsized":"2024-09-21T00:45:21.839583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.804755+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:44:47.804755+0000","last_peered":"2024-09-21T00:44:47.804755+0000","last_clean":"2024-09-21T00:44:47.804755+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:44:47.804755+0000","last_undegraded":"2024-09-21T00:44:47.804755+0000","last_fullsized":"2024-09-21T00:44:47.804755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797980+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:47.797980+0000","last_peered":"2024-09-21T00:44:47.797980+0000","last_clean":"2024-09-21T00:44:47.797980+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:47.797980+0000","last_undegraded":"2024-09-21T00:44:47.797980+0000","last_fullsized":"2024-09-21T00:44:47.797980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799446+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:47.799446+0000","last_peered":"2024-09-21T00:44:47.799446+0000","last_clean":"2024-09-21T00:44:47.799446+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:47.799446+0000","last_undegraded":"2024-09-21T00:44:47.799446+0000","last_fullsized":"2024-09-21T00:44:47.799446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800639+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:44:47.800639+0000","last_peered":"2024-09-21T00:44:47.800639+0000","last_clean":"2024-09-21T00:44:47.800639+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:44:47.800639+0000","last_undegraded":"2024-09-21T00:44:47.800639+0000","last_fullsized":"2024-09-21T00:44:47.800639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803565+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:47.803565+0000","last_peered":"2024-09-21T00:44:47.803565+0000","last_clean":"2024-09-21T00:44:47.803565+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:47.803565+0000","last_undegraded":"2024-09-21T00:44:47.803565+0000","last_fullsized":"2024-09-21T00:44:47.803565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796462+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:44:47.796462+0000","last_peered":"2024-09-21T00:44:47.796462+0000","last_clean":"2024-09-21T00:44:47.796462+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:44:47.796462+0000","last_undegraded":"2024-09-21T00:44:47.796462+0000","last_fullsized":"2024-09-21T00:44:47.796462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837730+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:45:20.837730+0000","last_peered":"2024-09-21T00:45:20.837730+0000","last_clean":"2024-09-21T00:45:20.837730+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:45:20.837730+0000","last_undegraded":"2024-09-21T00:45:20.837730+0000","last_fullsized":"2024-09-21T00:45:20.837730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844104+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:44:47.844104+0000","last_peered":"2024-09-21T00:44:47.844104+0000","last_clean":"2024-09-21T00:44:47.844104+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:44:47.844104+0000","last_undegraded":"2024-09-21T00:44:47.844104+0000","last_fullsized":"2024-09-21T00:44:47.844104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799157+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:47.799157+0000","last_peered":"2024-09-21T00:44:47.799157+0000","last_clean":"2024-09-21T00:44:47.799157+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:47.799157+0000","last_undegraded":"2024-09-21T00:44:47.799157+0000","last_fullsized":"2024-09-21T00:44:47.799157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803628+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:44:47.803628+0000","last_peered":"2024-09-21T00:44:47.803628+0000","last_clean":"2024-09-21T00:44:47.803628+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:44:47.803628+0000","last_undegraded":"2024-09-21T00:44:47.803628+0000","last_fullsized":"2024-09-21T00:44:47.803628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803641+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:47.803641+0000","last_peered":"2024-09-21T00:44:47.803641+0000","last_clean":"2024-09-21T00:44:47.803641+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:47.803641+0000","last_undegraded":"2024-09-21T00:44:47.803641+0000","last_fullsized":"2024-09-21T00:44:47.803641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844063+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:44:47.844063+0000","last_peered":"2024-09-21T00:44:47.844063+0000","last_clean":"2024-09-21T00:44:47.844063+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:44:47.844063+0000","last_undegraded":"2024-09-21T00:44:47.844063+0000","last_fullsized":"2024-09-21T00:44:47.844063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":163,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837775+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:45:20.837775+0000","last_peered":"2024-09-21T00:45:20.837775+0000","last_clean":"2024-09-21T00:45:20.837775+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:45:20.837775+0000","last_undegraded":"2024-09-21T00:45:20.837775+0000","last_fullsized":"2024-09-21T00:45:20.837775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":117,"num_write":32,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800483+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:44:47.800483+0000","last_peered":"2024-09-21T00:44:47.800483+0000","last_clean":"2024-09-21T00:44:47.800483+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:44:47.800483+0000","last_undegraded":"2024-09-21T00:44:47.800483+0000","last_fullsized":"2024-09-21T00:44:47.800483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803229+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:47.803229+0000","last_peered":"2024-09-21T00:44:47.803229+0000","last_clean":"2024-09-21T00:44:47.803229+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:47.803229+0000","last_undegraded":"2024-09-21T00:44:47.803229+0000","last_fullsized":"2024-09-21T00:44:47.803229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799784+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:44:47.799784+0000","last_peered":"2024-09-21T00:44:47.799784+0000","last_clean":"2024-09-21T00:44:47.799784+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:44:47.799784+0000","last_undegraded":"2024-09-21T00:44:47.799784+0000","last_fullsized":"2024-09-21T00:44:47.799784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803744+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:47.803744+0000","last_peered":"2024-09-21T00:44:47.803744+0000","last_clean":"2024-09-21T00:44:47.803744+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:47.803744+0000","last_undegraded":"2024-09-21T00:44:47.803744+0000","last_fullsized":"2024-09-21T00:44:47.803744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798792+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:44:47.798792+0000","last_peered":"2024-09-21T00:44:47.798792+0000","last_clean":"2024-09-21T00:44:47.798792+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:44:47.798792+0000","last_undegraded":"2024-09-21T00:44:47.798792+0000","last_fullsized":"2024-09-21T00:44:47.798792+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837765+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:45:20.837765+0000","last_peered":"2024-09-21T00:45:20.837765+0000","last_clean":"2024-09-21T00:45:20.837765+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:45:20.837765+0000","last_undegraded":"2024-09-21T00:45:20.837765+0000","last_fullsized":"2024-09-21T00:45:20.837765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799086+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:44:47.799086+0000","last_peered":"2024-09-21T00:44:47.799086+0000","last_clean":"2024-09-21T00:44:47.799086+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:44:47.799086+0000","last_undegraded":"2024-09-21T00:44:47.799086+0000","last_fullsized":"2024-09-21T00:44:47.799086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799995+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:47.799995+0000","last_peered":"2024-09-21T00:44:47.799995+0000","last_clean":"2024-09-21T00:44:47.799995+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:47.799995+0000","last_undegraded":"2024-09-21T00:44:47.799995+0000","last_fullsized":"2024-09-21T00:44:47.799995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844935+0000","last_change":"2024-09-21T00:44:47.844546+0000","last_active":"2024-09-21T00:44:47.844935+0000","last_peered":"2024-09-21T00:44:47.844935+0000","last_clean":"2024-09-21T00:44:47.844935+0000","last_became_active":"2024-09-21T00:44:47.844212+0000","last_became_peered":"2024-09-21T00:44:47.844212+0000","last_unstale":"2024-09-21T00:44:47.844935+0000","last_undegraded":"2024-09-21T00:44:47.844935+0000","last_fullsized":"2024-09-21T00:44:47.844935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.265217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800471+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:47.800471+0000","last_peered":"2024-09-21T00:44:47.800471+0000","last_clean":"2024-09-21T00:44:47.800471+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:47.800471+0000","last_undegraded":"2024-09-21T00:44:47.800471+0000","last_fullsized":"2024-09-21T00:44:47.800471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799516+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:44:47.799516+0000","last_peered":"2024-09-21T00:44:47.799516+0000","last_clean":"2024-09-21T00:44:47.799516+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:44:47.799516+0000","last_undegraded":"2024-09-21T00:44:47.799516+0000","last_fullsized":"2024-09-21T00:44:47.799516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799596+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:47.799596+0000","last_peered":"2024-09-21T00:44:47.799596+0000","last_clean":"2024-09-21T00:44:47.799596+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:47.799596+0000","last_undegraded":"2024-09-21T00:44:47.799596+0000","last_fullsized":"2024-09-21T00:44:47.799596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799416+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:44:47.799416+0000","last_peered":"2024-09-21T00:44:47.799416+0000","last_clean":"2024-09-21T00:44:47.799416+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:44:47.799416+0000","last_undegraded":"2024-09-21T00:44:47.799416+0000","last_fullsized":"2024-09-21T00:44:47.799416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803777+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:47.803777+0000","last_peered":"2024-09-21T00:44:47.803777+0000","last_clean":"2024-09-21T00:44:47.803777+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:47.803777+0000","last_undegraded":"2024-09-21T00:44:47.803777+0000","last_fullsized":"2024-09-21T00:44:47.803777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798726+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:44:47.798726+0000","last_peered":"2024-09-21T00:44:47.798726+0000","last_clean":"2024-09-21T00:44:47.798726+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:44:47.798726+0000","last_undegraded":"2024-09-21T00:44:47.798726+0000","last_fullsized":"2024-09-21T00:44:47.798726+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.857688+0000","last_change":"2024-09-21T00:44:47.811552+0000","last_active":"2024-09-21T00:45:20.857688+0000","last_peered":"2024-09-21T00:45:20.857688+0000","last_clean":"2024-09-21T00:45:20.857688+0000","last_became_active":"2024-09-21T00:44:47.804091+0000","last_became_peered":"2024-09-21T00:44:47.804091+0000","last_unstale":"2024-09-21T00:45:20.857688+0000","last_undegraded":"2024-09-21T00:45:20.857688+0000","last_fullsized":"2024-09-21T00:45:20.857688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:58.491825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1561,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799088+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:44:47.799088+0000","last_peered":"2024-09-21T00:44:47.799088+0000","last_clean":"2024-09-21T00:44:47.799088+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:44:47.799088+0000","last_undegraded":"2024-09-21T00:44:47.799088+0000","last_fullsized":"2024-09-21T00:44:47.799088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799250+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:47.799250+0000","last_peered":"2024-09-21T00:44:47.799250+0000","last_clean":"2024-09-21T00:44:47.799250+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:47.799250+0000","last_undegraded":"2024-09-21T00:44:47.799250+0000","last_fullsized":"2024-09-21T00:44:47.799250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800400+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:47.800400+0000","last_peered":"2024-09-21T00:44:47.800400+0000","last_clean":"2024-09-21T00:44:47.800400+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:47.800400+0000","last_undegraded":"2024-09-21T00:44:47.800400+0000","last_fullsized":"2024-09-21T00:44:47.800400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801141+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:44:47.801141+0000","last_peered":"2024-09-21T00:44:47.801141+0000","last_clean":"2024-09-21T00:44:47.801141+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:44:47.801141+0000","last_undegraded":"2024-09-21T00:44:47.801141+0000","last_fullsized":"2024-09-21T00:44:47.801141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.808921+0000","last_change":"2024-09-21T00:44:47.808807+0000","last_active":"2024-09-21T00:44:47.808921+0000","last_peered":"2024-09-21T00:44:47.808921+0000","last_clean":"2024-09-21T00:44:47.808921+0000","last_became_active":"2024-09-21T00:44:47.805581+0000","last_became_peered":"2024-09-21T00:44:47.805581+0000","last_unstale":"2024-09-21T00:44:47.808921+0000","last_undegraded":"2024-09-21T00:44:47.808921+0000","last_fullsized":"2024-09-21T00:44:47.808921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.570140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.805046+0000","last_change":"2024-09-21T00:44:47.804921+0000","last_active":"2024-09-21T00:44:47.805046+0000","last_peered":"2024-09-21T00:44:47.805046+0000","last_clean":"2024-09-21T00:44:47.805046+0000","last_became_active":"2024-09-21T00:44:47.804531+0000","last_became_peered":"2024-09-21T00:44:47.804531+0000","last_unstale":"2024-09-21T00:44:47.805046+0000","last_undegraded":"2024-09-21T00:44:47.805046+0000","last_fullsized":"2024-09-21T00:44:47.805046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:56.462438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:18.834103+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:45:18.834103+0000","last_peered":"2024-09-21T00:45:18.834103+0000","last_clean":"2024-09-21T00:45:18.834103+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:45:18.834103+0000","last_undegraded":"2024-09-21T00:45:18.834103+0000","last_fullsized":"2024-09-21T00:45:18.834103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803396+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:44:47.803396+0000","last_peered":"2024-09-21T00:44:47.803396+0000","last_clean":"2024-09-21T00:44:47.803396+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:44:47.803396+0000","last_undegraded":"2024-09-21T00:44:47.803396+0000","last_fullsized":"2024-09-21T00:44:47.803396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:17.833105+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:45:17.833105+0000","last_peered":"2024-09-21T00:45:17.833105+0000","last_clean":"2024-09-21T00:45:17.833105+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:45:17.833105+0000","last_undegraded":"2024-09-21T00:45:17.833105+0000","last_fullsized":"2024-09-21T00:45:17.833105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798048+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:44:47.798048+0000","last_peered":"2024-09-21T00:44:47.798048+0000","last_clean":"2024-09-21T00:44:47.798048+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:44:47.798048+0000","last_undegraded":"2024-09-21T00:44:47.798048+0000","last_fullsized":"2024-09-21T00:44:47.798048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796811+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:47.796811+0000","last_peered":"2024-09-21T00:44:47.796811+0000","last_clean":"2024-09-21T00:44:47.796811+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:47.796811+0000","last_undegraded":"2024-09-21T00:44:47.796811+0000","last_fullsized":"2024-09-21T00:44:47.796811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797993+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:44:47.797993+0000","last_peered":"2024-09-21T00:44:47.797993+0000","last_clean":"2024-09-21T00:44:47.797993+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:44:47.797993+0000","last_undegraded":"2024-09-21T00:44:47.797993+0000","last_fullsized":"2024-09-21T00:44:47.797993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800530+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:47.800530+0000","last_peered":"2024-09-21T00:44:47.800530+0000","last_clean":"2024-09-21T00:44:47.800530+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:47.800530+0000","last_undegraded":"2024-09-21T00:44:47.800530+0000","last_fullsized":"2024-09-21T00:44:47.800530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800190+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:44:47.800190+0000","last_peered":"2024-09-21T00:44:47.800190+0000","last_clean":"2024-09-21T00:44:47.800190+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:44:47.800190+0000","last_undegraded":"2024-09-21T00:44:47.800190+0000","last_fullsized":"2024-09-21T00:44:47.800190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796677+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:44:47.796677+0000","last_peered":"2024-09-21T00:44:47.796677+0000","last_clean":"2024-09-21T00:44:47.796677+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:44:47.796677+0000","last_undegraded":"2024-09-21T00:44:47.796677+0000","last_fullsized":"2024-09-21T00:44:47.796677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801427+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:44:47.801427+0000","last_peered":"2024-09-21T00:44:47.801427+0000","last_clean":"2024-09-21T00:44:47.801427+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:44:47.801427+0000","last_undegraded":"2024-09-21T00:44:47.801427+0000","last_fullsized":"2024-09-21T00:44:47.801427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800939+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:47.800939+0000","last_peered":"2024-09-21T00:44:47.800939+0000","last_clean":"2024-09-21T00:44:47.800939+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:47.800939+0000","last_undegraded":"2024-09-21T00:44:47.800939+0000","last_fullsized":"2024-09-21T00:44:47.800939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803693+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:44:47.803693+0000","last_peered":"2024-09-21T00:44:47.803693+0000","last_clean":"2024-09-21T00:44:47.803693+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:44:47.803693+0000","last_undegraded":"2024-09-21T00:44:47.803693+0000","last_fullsized":"2024-09-21T00:44:47.803693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843924+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:47.843924+0000","last_peered":"2024-09-21T00:44:47.843924+0000","last_clean":"2024-09-21T00:44:47.843924+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:47.843924+0000","last_undegraded":"2024-09-21T00:44:47.843924+0000","last_fullsized":"2024-09-21T00:44:47.843924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799313+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:44:47.799313+0000","last_peered":"2024-09-21T00:44:47.799313+0000","last_clean":"2024-09-21T00:44:47.799313+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:44:47.799313+0000","last_undegraded":"2024-09-21T00:44:47.799313+0000","last_fullsized":"2024-09-21T00:44:47.799313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800965+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:47.800965+0000","last_peered":"2024-09-21T00:44:47.800965+0000","last_clean":"2024-09-21T00:44:47.800965+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:47.800965+0000","last_undegraded":"2024-09-21T00:44:47.800965+0000","last_fullsized":"2024-09-21T00:44:47.800965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799937+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:44:47.799937+0000","last_peered":"2024-09-21T00:44:47.799937+0000","last_clean":"2024-09-21T00:44:47.799937+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:44:47.799937+0000","last_undegraded":"2024-09-21T00:44:47.799937+0000","last_fullsized":"2024-09-21T00:44:47.799937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803471+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:47.803471+0000","last_peered":"2024-09-21T00:44:47.803471+0000","last_clean":"2024-09-21T00:44:47.803471+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:47.803471+0000","last_undegraded":"2024-09-21T00:44:47.803471+0000","last_fullsized":"2024-09-21T00:44:47.803471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800785+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:44:47.800785+0000","last_peered":"2024-09-21T00:44:47.800785+0000","last_clean":"2024-09-21T00:44:47.800785+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:44:47.800785+0000","last_undegraded":"2024-09-21T00:44:47.800785+0000","last_fullsized":"2024-09-21T00:44:47.800785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800088+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:47.800088+0000","last_peered":"2024-09-21T00:44:47.800088+0000","last_clean":"2024-09-21T00:44:47.800088+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:47.800088+0000","last_undegraded":"2024-09-21T00:44:47.800088+0000","last_fullsized":"2024-09-21T00:44:47.800088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798760+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:44:47.798760+0000","last_peered":"2024-09-21T00:44:47.798760+0000","last_clean":"2024-09-21T00:44:47.798760+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:44:47.798760+0000","last_undegraded":"2024-09-21T00:44:47.798760+0000","last_fullsized":"2024-09-21T00:44:47.798760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803619+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:44:47.803619+0000","last_peered":"2024-09-21T00:44:47.803619+0000","last_clean":"2024-09-21T00:44:47.803619+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:44:47.803619+0000","last_undegraded":"2024-09-21T00:44:47.803619+0000","last_fullsized":"2024-09-21T00:44:47.803619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799986+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:47.799986+0000","last_peered":"2024-09-21T00:44:47.799986+0000","last_clean":"2024-09-21T00:44:47.799986+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:47.799986+0000","last_undegraded":"2024-09-21T00:44:47.799986+0000","last_fullsized":"2024-09-21T00:44:47.799986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843872+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:44:47.843872+0000","last_peered":"2024-09-21T00:44:47.843872+0000","last_clean":"2024-09-21T00:44:47.843872+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:44:47.843872+0000","last_undegraded":"2024-09-21T00:44:47.843872+0000","last_fullsized":"2024-09-21T00:44:47.843872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.862814+0000","last_change":"2024-09-21T00:44:47.862708+0000","last_active":"2024-09-21T00:44:47.862814+0000","last_peered":"2024-09-21T00:44:47.862814+0000","last_clean":"2024-09-21T00:44:47.862814+0000","last_became_active":"2024-09-21T00:44:47.845236+0000","last_became_peered":"2024-09-21T00:44:47.845236+0000","last_unstale":"2024-09-21T00:44:47.862814+0000","last_undegraded":"2024-09-21T00:44:47.862814+0000","last_fullsized":"2024-09-21T00:44:47.862814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:03.770440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803593+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:44:47.803593+0000","last_peered":"2024-09-21T00:44:47.803593+0000","last_clean":"2024-09-21T00:44:47.803593+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:44:47.803593+0000","last_undegraded":"2024-09-21T00:44:47.803593+0000","last_fullsized":"2024-09-21T00:44:47.803593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801587+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:47.801587+0000","last_peered":"2024-09-21T00:44:47.801587+0000","last_clean":"2024-09-21T00:44:47.801587+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:47.801587+0000","last_undegraded":"2024-09-21T00:44:47.801587+0000","last_fullsized":"2024-09-21T00:44:47.801587+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801430+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:44:47.801430+0000","last_peered":"2024-09-21T00:44:47.801430+0000","last_clean":"2024-09-21T00:44:47.801430+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:44:47.801430+0000","last_undegraded":"2024-09-21T00:44:47.801430+0000","last_fullsized":"2024-09-21T00:44:47.801430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:19.835467+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:45:19.835467+0000","last_peered":"2024-09-21T00:45:19.835467+0000","last_clean":"2024-09-21T00:45:19.835467+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:45:19.835467+0000","last_undegraded":"2024-09-21T00:45:19.835467+0000","last_fullsized":"2024-09-21T00:45:19.835467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":536,"num_read_kb":352,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1561,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":214491,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":400138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1054678,"data_compressed":38165,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168613,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":399677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364842,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":400055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561070,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":992964,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724596,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":399785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920825,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":992251,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084351,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":400816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":399219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":463650,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":464600,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":851968,"data_stored":401124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66045,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65095,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65638,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:45:26.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:45:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:45:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:45:27.020 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:27.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:45:27.036 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:45:27.037 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:45:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:27.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 -- 172.21.15.16:0/532653326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 msgr2=0x7f59a81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:27.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 --2- 172.21.15.16:0/532653326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a81087d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f599c009900 tx=0x7f599c02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 -- 172.21.15.16:0/532653326 shutdown_connections 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 --2- 172.21.15.16:0/532653326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8108d10 0x7f59a810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 --2- 172.21.15.16:0/532653326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a81087d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 --2- 172.21.15.16:0/532653326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8102a80 0x7f59a8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 -- 172.21.15.16:0/532653326 >> 172.21.15.16:0/532653326 conn(0x7f59a8079740 msgr2=0x7f59a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 -- 172.21.15.16:0/532653326 shutdown_connections 2024-09-21T00:45:27.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.720+0000 7f59acffb640 1 -- 172.21.15.16:0/532653326 wait complete. 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 Processor -- start 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 -- start start 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8102a80 0x7f59a80ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8108d10 0x7f59a8100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8112980 con 0x7f59a81083c0 2024-09-21T00:45:27.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8112800 con 0x7f59a8102a80 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.721+0000 7f59acffb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8112b00 con 0x7f59a8108d10 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52688/0 (socket says 172.21.15.16:52688) 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 -- 172.21.15.16:0/3219669472 learned_addr learned my addr 172.21.15.16:0/3219669472 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a6d9d640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8108d10 0x7f59a8100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a659c640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8102a80 0x7f59a80ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 -- 172.21.15.16:0/3219669472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8108d10 msgr2=0x7f59a8100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8108d10 0x7f59a8100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 -- 172.21.15.16:0/3219669472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8102a80 msgr2=0x7f59a80ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8102a80 0x7f59a80ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 -- 172.21.15.16:0/3219669472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a81a8760 con 0x7f59a81083c0 2024-09-21T00:45:27.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59a5d9b640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f599c032fd0 tx=0x7f599c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c03f030 con 0x7f59a81083c0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f599c004490 con 0x7f59a81083c0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.722+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a81a89f0 con 0x7f59a81083c0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.723+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c035070 con 0x7f59a81083c0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.723+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a81a8ed0 con 0x7f59a81083c0 2024-09-21T00:45:27.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.724+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8103d00 con 0x7f59a81083c0 2024-09-21T00:45:27.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.725+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f599c042030 con 0x7f59a81083c0 2024-09-21T00:45:27.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.726+0000 7f59977fe640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 0x7f59900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:27.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.726+0000 7f59a659c640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 0x7f59900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:27.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.726+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f599c107db0 con 0x7f59a81083c0 2024-09-21T00:45:27.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.727+0000 7f59a659c640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 0x7f59900b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5998005fd0 tx=0x7f5998005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:27.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.730+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f599c0ce550 con 0x7f59a81083c0 2024-09-21T00:45:27.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.917+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59a8063800 con 0x7f59900b65a0 2024-09-21T00:45:27.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.922+0000 7f59977fe640 1 -- 172.21.15.16:0/3219669472 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258973 (secure 0 0 0) 0x7f59a8063800 con 0x7f59900b65a0 2024-09-21T00:45:27.925 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:27.926 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 msgr2=0x7f59900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 0x7f59900b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5998005fd0 tx=0x7f5998005850 comp rx=0 tx=0).stop 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 msgr2=0x7f59a80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f599c032fd0 tx=0x7f599c004270 comp rx=0 tx=0).stop 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 shutdown_connections 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f59900b65a0 0x7f59900b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59a8108d10 0x7f59a8100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59a81083c0 0x7f59a80ffbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 --2- 172.21.15.16:0/3219669472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59a8102a80 0x7f59a80ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:27.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 >> 172.21.15.16:0/3219669472 conn(0x7f59a8079740 msgr2=0x7f59a806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:27.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 shutdown_connections 2024-09-21T00:45:27.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:27.925+0000 7f59acffb640 1 -- 172.21.15.16:0/3219669472 wait complete. 2024-09-21T00:45:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:27 smithi016 ceph-mon[30947]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:27 smithi016 ceph-mon[30947]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:27 smithi123 ceph-mon[34853]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:27 smithi123 ceph-mon[34853]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:28.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:27 smithi178 ceph-mon[34888]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:28.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:27 smithi178 ceph-mon[34888]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:28.640 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-21T00:45:26.272596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662099,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":627,"num_read_kb":426,"num_write":371,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953401,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380328,"kb_used_data":10224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561496,"statfs":{"total":1151940427776,"available":1151550971904,"internally_reserved":0,"allocated":10469376,"data_stored":6768957,"data_compressed":114495,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003432"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800403+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:44:47.800403+0000","last_peered":"2024-09-21T00:44:47.800403+0000","last_clean":"2024-09-21T00:44:47.800403+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:44:47.800403+0000","last_undegraded":"2024-09-21T00:44:47.800403+0000","last_fullsized":"2024-09-21T00:44:47.800403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803042+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:44:47.803042+0000","last_peered":"2024-09-21T00:44:47.803042+0000","last_clean":"2024-09-21T00:44:47.803042+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:44:47.803042+0000","last_undegraded":"2024-09-21T00:44:47.803042+0000","last_fullsized":"2024-09-21T00:44:47.803042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803214+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:44:47.803214+0000","last_peered":"2024-09-21T00:44:47.803214+0000","last_clean":"2024-09-21T00:44:47.803214+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:44:47.803214+0000","last_undegraded":"2024-09-21T00:44:47.803214+0000","last_fullsized":"2024-09-21T00:44:47.803214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800798+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:44:47.800798+0000","last_peered":"2024-09-21T00:44:47.800798+0000","last_clean":"2024-09-21T00:44:47.800798+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:44:47.800798+0000","last_undegraded":"2024-09-21T00:44:47.800798+0000","last_fullsized":"2024-09-21T00:44:47.800798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799952+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:44:47.799952+0000","last_peered":"2024-09-21T00:44:47.799952+0000","last_clean":"2024-09-21T00:44:47.799952+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:44:47.799952+0000","last_undegraded":"2024-09-21T00:44:47.799952+0000","last_fullsized":"2024-09-21T00:44:47.799952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797804+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:44:47.797804+0000","last_peered":"2024-09-21T00:44:47.797804+0000","last_clean":"2024-09-21T00:44:47.797804+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:44:47.797804+0000","last_undegraded":"2024-09-21T00:44:47.797804+0000","last_fullsized":"2024-09-21T00:44:47.797804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798415+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:44:47.798415+0000","last_peered":"2024-09-21T00:44:47.798415+0000","last_clean":"2024-09-21T00:44:47.798415+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:44:47.798415+0000","last_undegraded":"2024-09-21T00:44:47.798415+0000","last_fullsized":"2024-09-21T00:44:47.798415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800636+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:44:47.800636+0000","last_peered":"2024-09-21T00:44:47.800636+0000","last_clean":"2024-09-21T00:44:47.800636+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:44:47.800636+0000","last_undegraded":"2024-09-21T00:44:47.800636+0000","last_fullsized":"2024-09-21T00:44:47.800636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844329+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:44:47.844329+0000","last_peered":"2024-09-21T00:44:47.844329+0000","last_clean":"2024-09-21T00:44:47.844329+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:44:47.844329+0000","last_undegraded":"2024-09-21T00:44:47.844329+0000","last_fullsized":"2024-09-21T00:44:47.844329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.805196+0000","last_change":"2024-09-21T00:44:47.805103+0000","last_active":"2024-09-21T00:44:47.805196+0000","last_peered":"2024-09-21T00:44:47.805196+0000","last_clean":"2024-09-21T00:44:47.805196+0000","last_became_active":"2024-09-21T00:44:47.804708+0000","last_became_peered":"2024-09-21T00:44:47.804708+0000","last_unstale":"2024-09-21T00:44:47.805196+0000","last_undegraded":"2024-09-21T00:44:47.805196+0000","last_fullsized":"2024-09-21T00:44:47.805196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:18.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798953+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:44:47.798953+0000","last_peered":"2024-09-21T00:44:47.798953+0000","last_clean":"2024-09-21T00:44:47.798953+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:44:47.798953+0000","last_undegraded":"2024-09-21T00:44:47.798953+0000","last_fullsized":"2024-09-21T00:44:47.798953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800954+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:44:47.800954+0000","last_peered":"2024-09-21T00:44:47.800954+0000","last_clean":"2024-09-21T00:44:47.800954+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:44:47.800954+0000","last_undegraded":"2024-09-21T00:44:47.800954+0000","last_fullsized":"2024-09-21T00:44:47.800954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799799+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:44:47.799799+0000","last_peered":"2024-09-21T00:44:47.799799+0000","last_clean":"2024-09-21T00:44:47.799799+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:44:47.799799+0000","last_undegraded":"2024-09-21T00:44:47.799799+0000","last_fullsized":"2024-09-21T00:44:47.799799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803430+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:44:47.803430+0000","last_peered":"2024-09-21T00:44:47.803430+0000","last_clean":"2024-09-21T00:44:47.803430+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:44:47.803430+0000","last_undegraded":"2024-09-21T00:44:47.803430+0000","last_fullsized":"2024-09-21T00:44:47.803430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.802939+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:44:47.802939+0000","last_peered":"2024-09-21T00:44:47.802939+0000","last_clean":"2024-09-21T00:44:47.802939+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:44:47.802939+0000","last_undegraded":"2024-09-21T00:44:47.802939+0000","last_fullsized":"2024-09-21T00:44:47.802939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843720+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:44:47.843720+0000","last_peered":"2024-09-21T00:44:47.843720+0000","last_clean":"2024-09-21T00:44:47.843720+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:44:47.843720+0000","last_undegraded":"2024-09-21T00:44:47.843720+0000","last_fullsized":"2024-09-21T00:44:47.843720+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800531+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:44:47.800531+0000","last_peered":"2024-09-21T00:44:47.800531+0000","last_clean":"2024-09-21T00:44:47.800531+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:44:47.800531+0000","last_undegraded":"2024-09-21T00:44:47.800531+0000","last_fullsized":"2024-09-21T00:44:47.800531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796628+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:44:47.796628+0000","last_peered":"2024-09-21T00:44:47.796628+0000","last_clean":"2024-09-21T00:44:47.796628+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:44:47.796628+0000","last_undegraded":"2024-09-21T00:44:47.796628+0000","last_fullsized":"2024-09-21T00:44:47.796628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803375+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:44:47.803375+0000","last_peered":"2024-09-21T00:44:47.803375+0000","last_clean":"2024-09-21T00:44:47.803375+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:44:47.803375+0000","last_undegraded":"2024-09-21T00:44:47.803375+0000","last_fullsized":"2024-09-21T00:44:47.803375+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799221+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:44:47.799221+0000","last_peered":"2024-09-21T00:44:47.799221+0000","last_clean":"2024-09-21T00:44:47.799221+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:44:47.799221+0000","last_undegraded":"2024-09-21T00:44:47.799221+0000","last_fullsized":"2024-09-21T00:44:47.799221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799907+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:44:47.799907+0000","last_peered":"2024-09-21T00:44:47.799907+0000","last_clean":"2024-09-21T00:44:47.799907+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:44:47.799907+0000","last_undegraded":"2024-09-21T00:44:47.799907+0000","last_fullsized":"2024-09-21T00:44:47.799907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843912+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:44:47.843912+0000","last_peered":"2024-09-21T00:44:47.843912+0000","last_clean":"2024-09-21T00:44:47.843912+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:44:47.843912+0000","last_undegraded":"2024-09-21T00:44:47.843912+0000","last_fullsized":"2024-09-21T00:44:47.843912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800859+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:44:47.800859+0000","last_peered":"2024-09-21T00:44:47.800859+0000","last_clean":"2024-09-21T00:44:47.800859+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:44:47.800859+0000","last_undegraded":"2024-09-21T00:44:47.800859+0000","last_fullsized":"2024-09-21T00:44:47.800859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803279+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:44:47.803279+0000","last_peered":"2024-09-21T00:44:47.803279+0000","last_clean":"2024-09-21T00:44:47.803279+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:44:47.803279+0000","last_undegraded":"2024-09-21T00:44:47.803279+0000","last_fullsized":"2024-09-21T00:44:47.803279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801318+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:44:47.801318+0000","last_peered":"2024-09-21T00:44:47.801318+0000","last_clean":"2024-09-21T00:44:47.801318+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:44:47.801318+0000","last_undegraded":"2024-09-21T00:44:47.801318+0000","last_fullsized":"2024-09-21T00:44:47.801318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803586+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:44:47.803586+0000","last_peered":"2024-09-21T00:44:47.803586+0000","last_clean":"2024-09-21T00:44:47.803586+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:44:47.803586+0000","last_undegraded":"2024-09-21T00:44:47.803586+0000","last_fullsized":"2024-09-21T00:44:47.803586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799588+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:44:47.799588+0000","last_peered":"2024-09-21T00:44:47.799588+0000","last_clean":"2024-09-21T00:44:47.799588+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:44:47.799588+0000","last_undegraded":"2024-09-21T00:44:47.799588+0000","last_fullsized":"2024-09-21T00:44:47.799588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800089+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:44:47.800089+0000","last_peered":"2024-09-21T00:44:47.800089+0000","last_clean":"2024-09-21T00:44:47.800089+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:44:47.800089+0000","last_undegraded":"2024-09-21T00:44:47.800089+0000","last_fullsized":"2024-09-21T00:44:47.800089+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803321+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:44:47.803321+0000","last_peered":"2024-09-21T00:44:47.803321+0000","last_clean":"2024-09-21T00:44:47.803321+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:44:47.803321+0000","last_undegraded":"2024-09-21T00:44:47.803321+0000","last_fullsized":"2024-09-21T00:44:47.803321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803333+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:44:47.803333+0000","last_peered":"2024-09-21T00:44:47.803333+0000","last_clean":"2024-09-21T00:44:47.803333+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:44:47.803333+0000","last_undegraded":"2024-09-21T00:44:47.803333+0000","last_fullsized":"2024-09-21T00:44:47.803333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803872+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:44:47.803872+0000","last_peered":"2024-09-21T00:44:47.803872+0000","last_clean":"2024-09-21T00:44:47.803872+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:44:47.803872+0000","last_undegraded":"2024-09-21T00:44:47.803872+0000","last_fullsized":"2024-09-21T00:44:47.803872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800208+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:44:47.800208+0000","last_peered":"2024-09-21T00:44:47.800208+0000","last_clean":"2024-09-21T00:44:47.800208+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:44:47.800208+0000","last_undegraded":"2024-09-21T00:44:47.800208+0000","last_fullsized":"2024-09-21T00:44:47.800208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799578+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:44:47.799578+0000","last_peered":"2024-09-21T00:44:47.799578+0000","last_clean":"2024-09-21T00:44:47.799578+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:44:47.799578+0000","last_undegraded":"2024-09-21T00:44:47.799578+0000","last_fullsized":"2024-09-21T00:44:47.799578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:21.839583+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:45:21.839583+0000","last_peered":"2024-09-21T00:45:21.839583+0000","last_clean":"2024-09-21T00:45:21.839583+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:45:21.839583+0000","last_undegraded":"2024-09-21T00:45:21.839583+0000","last_fullsized":"2024-09-21T00:45:21.839583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.804755+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:44:47.804755+0000","last_peered":"2024-09-21T00:44:47.804755+0000","last_clean":"2024-09-21T00:44:47.804755+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:44:47.804755+0000","last_undegraded":"2024-09-21T00:44:47.804755+0000","last_fullsized":"2024-09-21T00:44:47.804755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797980+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:47.797980+0000","last_peered":"2024-09-21T00:44:47.797980+0000","last_clean":"2024-09-21T00:44:47.797980+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:47.797980+0000","last_undegraded":"2024-09-21T00:44:47.797980+0000","last_fullsized":"2024-09-21T00:44:47.797980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799446+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:47.799446+0000","last_peered":"2024-09-21T00:44:47.799446+0000","last_clean":"2024-09-21T00:44:47.799446+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:47.799446+0000","last_undegraded":"2024-09-21T00:44:47.799446+0000","last_fullsized":"2024-09-21T00:44:47.799446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800639+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:44:47.800639+0000","last_peered":"2024-09-21T00:44:47.800639+0000","last_clean":"2024-09-21T00:44:47.800639+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:44:47.800639+0000","last_undegraded":"2024-09-21T00:44:47.800639+0000","last_fullsized":"2024-09-21T00:44:47.800639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803565+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:47.803565+0000","last_peered":"2024-09-21T00:44:47.803565+0000","last_clean":"2024-09-21T00:44:47.803565+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:47.803565+0000","last_undegraded":"2024-09-21T00:44:47.803565+0000","last_fullsized":"2024-09-21T00:44:47.803565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796462+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:44:47.796462+0000","last_peered":"2024-09-21T00:44:47.796462+0000","last_clean":"2024-09-21T00:44:47.796462+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:44:47.796462+0000","last_undegraded":"2024-09-21T00:44:47.796462+0000","last_fullsized":"2024-09-21T00:44:47.796462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837730+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:45:20.837730+0000","last_peered":"2024-09-21T00:45:20.837730+0000","last_clean":"2024-09-21T00:45:20.837730+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:45:20.837730+0000","last_undegraded":"2024-09-21T00:45:20.837730+0000","last_fullsized":"2024-09-21T00:45:20.837730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844104+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:44:47.844104+0000","last_peered":"2024-09-21T00:44:47.844104+0000","last_clean":"2024-09-21T00:44:47.844104+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:44:47.844104+0000","last_undegraded":"2024-09-21T00:44:47.844104+0000","last_fullsized":"2024-09-21T00:44:47.844104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799157+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:47.799157+0000","last_peered":"2024-09-21T00:44:47.799157+0000","last_clean":"2024-09-21T00:44:47.799157+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:47.799157+0000","last_undegraded":"2024-09-21T00:44:47.799157+0000","last_fullsized":"2024-09-21T00:44:47.799157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803628+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:44:47.803628+0000","last_peered":"2024-09-21T00:44:47.803628+0000","last_clean":"2024-09-21T00:44:47.803628+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:44:47.803628+0000","last_undegraded":"2024-09-21T00:44:47.803628+0000","last_fullsized":"2024-09-21T00:44:47.803628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803641+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:47.803641+0000","last_peered":"2024-09-21T00:44:47.803641+0000","last_clean":"2024-09-21T00:44:47.803641+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:47.803641+0000","last_undegraded":"2024-09-21T00:44:47.803641+0000","last_fullsized":"2024-09-21T00:44:47.803641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844063+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:44:47.844063+0000","last_peered":"2024-09-21T00:44:47.844063+0000","last_clean":"2024-09-21T00:44:47.844063+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:44:47.844063+0000","last_undegraded":"2024-09-21T00:44:47.844063+0000","last_fullsized":"2024-09-21T00:44:47.844063+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":163,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837775+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:45:20.837775+0000","last_peered":"2024-09-21T00:45:20.837775+0000","last_clean":"2024-09-21T00:45:20.837775+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:45:20.837775+0000","last_undegraded":"2024-09-21T00:45:20.837775+0000","last_fullsized":"2024-09-21T00:45:20.837775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":117,"num_write":32,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800483+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:44:47.800483+0000","last_peered":"2024-09-21T00:44:47.800483+0000","last_clean":"2024-09-21T00:44:47.800483+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:44:47.800483+0000","last_undegraded":"2024-09-21T00:44:47.800483+0000","last_fullsized":"2024-09-21T00:44:47.800483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803229+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:47.803229+0000","last_peered":"2024-09-21T00:44:47.803229+0000","last_clean":"2024-09-21T00:44:47.803229+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:47.803229+0000","last_undegraded":"2024-09-21T00:44:47.803229+0000","last_fullsized":"2024-09-21T00:44:47.803229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799784+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:44:47.799784+0000","last_peered":"2024-09-21T00:44:47.799784+0000","last_clean":"2024-09-21T00:44:47.799784+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:44:47.799784+0000","last_undegraded":"2024-09-21T00:44:47.799784+0000","last_fullsized":"2024-09-21T00:44:47.799784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803744+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:47.803744+0000","last_peered":"2024-09-21T00:44:47.803744+0000","last_clean":"2024-09-21T00:44:47.803744+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:47.803744+0000","last_undegraded":"2024-09-21T00:44:47.803744+0000","last_fullsized":"2024-09-21T00:44:47.803744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798792+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:44:47.798792+0000","last_peered":"2024-09-21T00:44:47.798792+0000","last_clean":"2024-09-21T00:44:47.798792+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:44:47.798792+0000","last_undegraded":"2024-09-21T00:44:47.798792+0000","last_fullsized":"2024-09-21T00:44:47.798792+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.837765+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:45:20.837765+0000","last_peered":"2024-09-21T00:45:20.837765+0000","last_clean":"2024-09-21T00:45:20.837765+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:45:20.837765+0000","last_undegraded":"2024-09-21T00:45:20.837765+0000","last_fullsized":"2024-09-21T00:45:20.837765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799086+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:44:47.799086+0000","last_peered":"2024-09-21T00:44:47.799086+0000","last_clean":"2024-09-21T00:44:47.799086+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:44:47.799086+0000","last_undegraded":"2024-09-21T00:44:47.799086+0000","last_fullsized":"2024-09-21T00:44:47.799086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799995+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:47.799995+0000","last_peered":"2024-09-21T00:44:47.799995+0000","last_clean":"2024-09-21T00:44:47.799995+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:47.799995+0000","last_undegraded":"2024-09-21T00:44:47.799995+0000","last_fullsized":"2024-09-21T00:44:47.799995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.844935+0000","last_change":"2024-09-21T00:44:47.844546+0000","last_active":"2024-09-21T00:44:47.844935+0000","last_peered":"2024-09-21T00:44:47.844935+0000","last_clean":"2024-09-21T00:44:47.844935+0000","last_became_active":"2024-09-21T00:44:47.844212+0000","last_became_peered":"2024-09-21T00:44:47.844212+0000","last_unstale":"2024-09-21T00:44:47.844935+0000","last_undegraded":"2024-09-21T00:44:47.844935+0000","last_fullsized":"2024-09-21T00:44:47.844935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.265217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800471+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:47.800471+0000","last_peered":"2024-09-21T00:44:47.800471+0000","last_clean":"2024-09-21T00:44:47.800471+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:47.800471+0000","last_undegraded":"2024-09-21T00:44:47.800471+0000","last_fullsized":"2024-09-21T00:44:47.800471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799516+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:44:47.799516+0000","last_peered":"2024-09-21T00:44:47.799516+0000","last_clean":"2024-09-21T00:44:47.799516+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:44:47.799516+0000","last_undegraded":"2024-09-21T00:44:47.799516+0000","last_fullsized":"2024-09-21T00:44:47.799516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799596+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:47.799596+0000","last_peered":"2024-09-21T00:44:47.799596+0000","last_clean":"2024-09-21T00:44:47.799596+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:47.799596+0000","last_undegraded":"2024-09-21T00:44:47.799596+0000","last_fullsized":"2024-09-21T00:44:47.799596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799416+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:44:47.799416+0000","last_peered":"2024-09-21T00:44:47.799416+0000","last_clean":"2024-09-21T00:44:47.799416+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:44:47.799416+0000","last_undegraded":"2024-09-21T00:44:47.799416+0000","last_fullsized":"2024-09-21T00:44:47.799416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803777+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:47.803777+0000","last_peered":"2024-09-21T00:44:47.803777+0000","last_clean":"2024-09-21T00:44:47.803777+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:47.803777+0000","last_undegraded":"2024-09-21T00:44:47.803777+0000","last_fullsized":"2024-09-21T00:44:47.803777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798726+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:44:47.798726+0000","last_peered":"2024-09-21T00:44:47.798726+0000","last_clean":"2024-09-21T00:44:47.798726+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:44:47.798726+0000","last_undegraded":"2024-09-21T00:44:47.798726+0000","last_fullsized":"2024-09-21T00:44:47.798726+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:20.857688+0000","last_change":"2024-09-21T00:44:47.811552+0000","last_active":"2024-09-21T00:45:20.857688+0000","last_peered":"2024-09-21T00:45:20.857688+0000","last_clean":"2024-09-21T00:45:20.857688+0000","last_became_active":"2024-09-21T00:44:47.804091+0000","last_became_peered":"2024-09-21T00:44:47.804091+0000","last_unstale":"2024-09-21T00:45:20.857688+0000","last_undegraded":"2024-09-21T00:45:20.857688+0000","last_fullsized":"2024-09-21T00:45:20.857688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:58.491825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1561,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799088+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:44:47.799088+0000","last_peered":"2024-09-21T00:44:47.799088+0000","last_clean":"2024-09-21T00:44:47.799088+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:44:47.799088+0000","last_undegraded":"2024-09-21T00:44:47.799088+0000","last_fullsized":"2024-09-21T00:44:47.799088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799250+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:47.799250+0000","last_peered":"2024-09-21T00:44:47.799250+0000","last_clean":"2024-09-21T00:44:47.799250+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:47.799250+0000","last_undegraded":"2024-09-21T00:44:47.799250+0000","last_fullsized":"2024-09-21T00:44:47.799250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800400+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:47.800400+0000","last_peered":"2024-09-21T00:44:47.800400+0000","last_clean":"2024-09-21T00:44:47.800400+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:47.800400+0000","last_undegraded":"2024-09-21T00:44:47.800400+0000","last_fullsized":"2024-09-21T00:44:47.800400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801141+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:44:47.801141+0000","last_peered":"2024-09-21T00:44:47.801141+0000","last_clean":"2024-09-21T00:44:47.801141+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:44:47.801141+0000","last_undegraded":"2024-09-21T00:44:47.801141+0000","last_fullsized":"2024-09-21T00:44:47.801141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.808921+0000","last_change":"2024-09-21T00:44:47.808807+0000","last_active":"2024-09-21T00:44:47.808921+0000","last_peered":"2024-09-21T00:44:47.808921+0000","last_clean":"2024-09-21T00:44:47.808921+0000","last_became_active":"2024-09-21T00:44:47.805581+0000","last_became_peered":"2024-09-21T00:44:47.805581+0000","last_unstale":"2024-09-21T00:44:47.808921+0000","last_undegraded":"2024-09-21T00:44:47.808921+0000","last_fullsized":"2024-09-21T00:44:47.808921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.570140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.805046+0000","last_change":"2024-09-21T00:44:47.804921+0000","last_active":"2024-09-21T00:44:47.805046+0000","last_peered":"2024-09-21T00:44:47.805046+0000","last_clean":"2024-09-21T00:44:47.805046+0000","last_became_active":"2024-09-21T00:44:47.804531+0000","last_became_peered":"2024-09-21T00:44:47.804531+0000","last_unstale":"2024-09-21T00:44:47.805046+0000","last_undegraded":"2024-09-21T00:44:47.805046+0000","last_fullsized":"2024-09-21T00:44:47.805046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:56.462438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:23.841241+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:45:23.841241+0000","last_peered":"2024-09-21T00:45:23.841241+0000","last_clean":"2024-09-21T00:45:23.841241+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:45:23.841241+0000","last_undegraded":"2024-09-21T00:45:23.841241+0000","last_fullsized":"2024-09-21T00:45:23.841241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803396+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:44:47.803396+0000","last_peered":"2024-09-21T00:44:47.803396+0000","last_clean":"2024-09-21T00:44:47.803396+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:44:47.803396+0000","last_undegraded":"2024-09-21T00:44:47.803396+0000","last_fullsized":"2024-09-21T00:44:47.803396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:22.840158+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:45:22.840158+0000","last_peered":"2024-09-21T00:45:22.840158+0000","last_clean":"2024-09-21T00:45:22.840158+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:45:22.840158+0000","last_undegraded":"2024-09-21T00:45:22.840158+0000","last_fullsized":"2024-09-21T00:45:22.840158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798048+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:44:47.798048+0000","last_peered":"2024-09-21T00:44:47.798048+0000","last_clean":"2024-09-21T00:44:47.798048+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:44:47.798048+0000","last_undegraded":"2024-09-21T00:44:47.798048+0000","last_fullsized":"2024-09-21T00:44:47.798048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796811+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:47.796811+0000","last_peered":"2024-09-21T00:44:47.796811+0000","last_clean":"2024-09-21T00:44:47.796811+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:47.796811+0000","last_undegraded":"2024-09-21T00:44:47.796811+0000","last_fullsized":"2024-09-21T00:44:47.796811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797993+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:44:47.797993+0000","last_peered":"2024-09-21T00:44:47.797993+0000","last_clean":"2024-09-21T00:44:47.797993+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:44:47.797993+0000","last_undegraded":"2024-09-21T00:44:47.797993+0000","last_fullsized":"2024-09-21T00:44:47.797993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800530+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:47.800530+0000","last_peered":"2024-09-21T00:44:47.800530+0000","last_clean":"2024-09-21T00:44:47.800530+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:47.800530+0000","last_undegraded":"2024-09-21T00:44:47.800530+0000","last_fullsized":"2024-09-21T00:44:47.800530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800190+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:44:47.800190+0000","last_peered":"2024-09-21T00:44:47.800190+0000","last_clean":"2024-09-21T00:44:47.800190+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:44:47.800190+0000","last_undegraded":"2024-09-21T00:44:47.800190+0000","last_fullsized":"2024-09-21T00:44:47.800190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796677+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:44:47.796677+0000","last_peered":"2024-09-21T00:44:47.796677+0000","last_clean":"2024-09-21T00:44:47.796677+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:44:47.796677+0000","last_undegraded":"2024-09-21T00:44:47.796677+0000","last_fullsized":"2024-09-21T00:44:47.796677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801427+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:44:47.801427+0000","last_peered":"2024-09-21T00:44:47.801427+0000","last_clean":"2024-09-21T00:44:47.801427+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:44:47.801427+0000","last_undegraded":"2024-09-21T00:44:47.801427+0000","last_fullsized":"2024-09-21T00:44:47.801427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800939+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:47.800939+0000","last_peered":"2024-09-21T00:44:47.800939+0000","last_clean":"2024-09-21T00:44:47.800939+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:47.800939+0000","last_undegraded":"2024-09-21T00:44:47.800939+0000","last_fullsized":"2024-09-21T00:44:47.800939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803693+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:44:47.803693+0000","last_peered":"2024-09-21T00:44:47.803693+0000","last_clean":"2024-09-21T00:44:47.803693+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:44:47.803693+0000","last_undegraded":"2024-09-21T00:44:47.803693+0000","last_fullsized":"2024-09-21T00:44:47.803693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843924+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:47.843924+0000","last_peered":"2024-09-21T00:44:47.843924+0000","last_clean":"2024-09-21T00:44:47.843924+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:47.843924+0000","last_undegraded":"2024-09-21T00:44:47.843924+0000","last_fullsized":"2024-09-21T00:44:47.843924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799313+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:44:47.799313+0000","last_peered":"2024-09-21T00:44:47.799313+0000","last_clean":"2024-09-21T00:44:47.799313+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:44:47.799313+0000","last_undegraded":"2024-09-21T00:44:47.799313+0000","last_fullsized":"2024-09-21T00:44:47.799313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800965+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:47.800965+0000","last_peered":"2024-09-21T00:44:47.800965+0000","last_clean":"2024-09-21T00:44:47.800965+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:47.800965+0000","last_undegraded":"2024-09-21T00:44:47.800965+0000","last_fullsized":"2024-09-21T00:44:47.800965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799937+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:44:47.799937+0000","last_peered":"2024-09-21T00:44:47.799937+0000","last_clean":"2024-09-21T00:44:47.799937+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:44:47.799937+0000","last_undegraded":"2024-09-21T00:44:47.799937+0000","last_fullsized":"2024-09-21T00:44:47.799937+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803471+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:47.803471+0000","last_peered":"2024-09-21T00:44:47.803471+0000","last_clean":"2024-09-21T00:44:47.803471+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:47.803471+0000","last_undegraded":"2024-09-21T00:44:47.803471+0000","last_fullsized":"2024-09-21T00:44:47.803471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800785+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:44:47.800785+0000","last_peered":"2024-09-21T00:44:47.800785+0000","last_clean":"2024-09-21T00:44:47.800785+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:44:47.800785+0000","last_undegraded":"2024-09-21T00:44:47.800785+0000","last_fullsized":"2024-09-21T00:44:47.800785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800088+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:47.800088+0000","last_peered":"2024-09-21T00:44:47.800088+0000","last_clean":"2024-09-21T00:44:47.800088+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:47.800088+0000","last_undegraded":"2024-09-21T00:44:47.800088+0000","last_fullsized":"2024-09-21T00:44:47.800088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.798760+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:44:47.798760+0000","last_peered":"2024-09-21T00:44:47.798760+0000","last_clean":"2024-09-21T00:44:47.798760+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:44:47.798760+0000","last_undegraded":"2024-09-21T00:44:47.798760+0000","last_fullsized":"2024-09-21T00:44:47.798760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803619+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:44:47.803619+0000","last_peered":"2024-09-21T00:44:47.803619+0000","last_clean":"2024-09-21T00:44:47.803619+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:44:47.803619+0000","last_undegraded":"2024-09-21T00:44:47.803619+0000","last_fullsized":"2024-09-21T00:44:47.803619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799986+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:47.799986+0000","last_peered":"2024-09-21T00:44:47.799986+0000","last_clean":"2024-09-21T00:44:47.799986+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:47.799986+0000","last_undegraded":"2024-09-21T00:44:47.799986+0000","last_fullsized":"2024-09-21T00:44:47.799986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843872+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:44:47.843872+0000","last_peered":"2024-09-21T00:44:47.843872+0000","last_clean":"2024-09-21T00:44:47.843872+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:44:47.843872+0000","last_undegraded":"2024-09-21T00:44:47.843872+0000","last_fullsized":"2024-09-21T00:44:47.843872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.862814+0000","last_change":"2024-09-21T00:44:47.862708+0000","last_active":"2024-09-21T00:44:47.862814+0000","last_peered":"2024-09-21T00:44:47.862814+0000","last_clean":"2024-09-21T00:44:47.862814+0000","last_became_active":"2024-09-21T00:44:47.845236+0000","last_became_peered":"2024-09-21T00:44:47.845236+0000","last_unstale":"2024-09-21T00:44:47.862814+0000","last_undegraded":"2024-09-21T00:44:47.862814+0000","last_fullsized":"2024-09-21T00:44:47.862814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:03.770440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803593+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:44:47.803593+0000","last_peered":"2024-09-21T00:44:47.803593+0000","last_clean":"2024-09-21T00:44:47.803593+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:44:47.803593+0000","last_undegraded":"2024-09-21T00:44:47.803593+0000","last_fullsized":"2024-09-21T00:44:47.803593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801587+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:47.801587+0000","last_peered":"2024-09-21T00:44:47.801587+0000","last_clean":"2024-09-21T00:44:47.801587+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:47.801587+0000","last_undegraded":"2024-09-21T00:44:47.801587+0000","last_fullsized":"2024-09-21T00:44:47.801587+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801430+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:44:47.801430+0000","last_peered":"2024-09-21T00:44:47.801430+0000","last_clean":"2024-09-21T00:44:47.801430+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:44:47.801430+0000","last_undegraded":"2024-09-21T00:44:47.801430+0000","last_fullsized":"2024-09-21T00:44:47.801430+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:24.842574+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:45:24.842574+0000","last_peered":"2024-09-21T00:45:24.842574+0000","last_clean":"2024-09-21T00:45:24.842574+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:45:24.842574+0000","last_undegraded":"2024-09-21T00:45:24.842574+0000","last_fullsized":"2024-09-21T00:45:24.842574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":551,"num_read_kb":362,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1561,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":214491,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":400138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1054678,"data_compressed":38165,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168614,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":399677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":400055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561071,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":992964,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724597,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":399785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920825,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":992251,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084351,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":400816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":399219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":463650,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":464600,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":851968,"data_stored":401124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66045,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65095,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65638,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:45:28.646 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:45:28.647 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T00:45:28.647 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T00:45:28.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T00:45:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:29.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:28 smithi016 ceph-mon[30947]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:28 smithi123 ceph-mon[34853]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:29.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:28 smithi178 ceph-mon[34888]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:45:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 -- 172.21.15.16:0/382062009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 msgr2=0x7f626410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 --2- 172.21.15.16:0/382062009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f626410f520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f625c009ca0 tx=0x7f625c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 -- 172.21.15.16:0/382062009 shutdown_connections 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 --2- 172.21.15.16:0/382062009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f626410f520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 --2- 172.21.15.16:0/382062009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 0x7f62641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 --2- 172.21.15.16:0/382062009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 0x7f6264102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 -- 172.21.15.16:0/382062009 >> 172.21.15.16:0/382062009 conn(0x7f6264079730 msgr2=0x7f6264079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 -- 172.21.15.16:0/382062009 shutdown_connections 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.461+0000 7f626bf3a640 1 -- 172.21.15.16:0/382062009 wait complete. 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 Processor -- start 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 -- start start 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 0x7f626410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 0x7f62641104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:29.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6264113ab0 con 0x7f6264108cf0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6264113930 con 0x7f6264102a60 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626bf3a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6264113c30 con 0x7f62641083a0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.462+0000 7f626a4d7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52694/0 (socket says 172.21.15.16:52694) 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 -- 172.21.15.16:0/3406032551 learned_addr learned my addr 172.21.15.16:0/3406032551 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f62694d5640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 0x7f62641104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f6269cd6640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 0x7f626410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 -- 172.21.15.16:0/3406032551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 msgr2=0x7f62641104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 0x7f62641104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 -- 172.21.15.16:0/3406032551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 msgr2=0x7f626410ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 0x7f626410ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 -- 172.21.15.16:0/3406032551 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641a8700 con 0x7f6264108cf0 2024-09-21T00:45:29.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626a4d7640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f625c009430 tx=0x7f625c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c003c30 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641a8990 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f625c003dd0 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c02faa0 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.463+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641a8f20 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.465+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6264102e70 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.467+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f625c02fc40 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.468+0000 7f625affd640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 0x7f62500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.468+0000 7f6269cd6640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 0x7f62500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.468+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f625c108850 con 0x7f6264108cf0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.469+0000 7f6269cd6640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 0x7f62500b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6264111a00 tx=0x7f626000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:29.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.471+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f625c0cf070 con 0x7f6264108cf0 2024-09-21T00:45:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.704+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62641112b0 con 0x7f6264108cf0 2024-09-21T00:45:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.704+0000 7f625affd640 1 -- 172.21.15.16:0/3406032551 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f62641112b0 con 0x7f6264108cf0 2024-09-21T00:45:29.706 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:29.706 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 msgr2=0x7f62500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 0x7f62500b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6264111a00 tx=0x7f626000b410 comp rx=0 tx=0).stop 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 msgr2=0x7f6264110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f625c009430 tx=0x7f625c0319f0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 shutdown_connections 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f62500b65a0 0x7f62500b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6264108cf0 0x7f6264110a30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62641083a0 0x7f62641104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 --2- 172.21.15.16:0/3406032551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6264102a60 0x7f626410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:29.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 >> 172.21.15.16:0/3406032551 conn(0x7f6264079730 msgr2=0x7f6264104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:29.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 shutdown_connections 2024-09-21T00:45:29.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:29.707+0000 7f626bf3a640 1 -- 172.21.15.16:0/3406032551 wait complete. 2024-09-21T00:45:29.972 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:29 smithi016 ceph-mon[30947]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:29.972 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3406032551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:45:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:29 smithi123 ceph-mon[34853]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:30.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:29 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3406032551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:45:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:29 smithi178 ceph-mon[34888]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3406032551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:45:30.447 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T00:45:30.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:45:30.710 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:31.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 -- 172.21.15.16:0/1792248173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 msgr2=0x7fe8541024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:31.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 --2- 172.21.15.16:0/1792248173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe8541024d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe85002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:31.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 -- 172.21.15.16:0/1792248173 shutdown_connections 2024-09-21T00:45:31.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 --2- 172.21.15.16:0/1792248173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 0x7fe854110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 --2- 172.21.15.16:0/1792248173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 0x7fe8541066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 --2- 172.21.15.16:0/1792248173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe8541024d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 -- 172.21.15.16:0/1792248173 >> 172.21.15.16:0/1792248173 conn(0x7fe854079e40 msgr2=0x7fe85407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 -- 172.21.15.16:0/1792248173 shutdown_connections 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.218+0000 7fe85c731640 1 -- 172.21.15.16:0/1792248173 wait complete. 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 Processor -- start 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 -- start start 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 0x7fe85419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 0x7fe85419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe854113b00 con 0x7fe8541020c0 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe854113980 con 0x7fe854106c00 2024-09-21T00:45:31.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85c731640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe854113c80 con 0x7fe8541062b0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85a4cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85a4cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52700/0 (socket says 172.21.15.16:52700) 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85a4cd640 1 -- 172.21.15.16:0/3868207125 learned_addr learned my addr 172.21.15.16:0/3868207125 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe85acce640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 0x7fe85419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.219+0000 7fe859ccc640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 0x7fe85419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 -- 172.21.15.16:0/3868207125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 msgr2=0x7fe85419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 0x7fe85419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 -- 172.21.15.16:0/3868207125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 msgr2=0x7fe85419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 0x7fe85419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 -- 172.21.15.16:0/3868207125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8541a0460 con 0x7fe8541020c0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85a4cd640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:31.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85003f030 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe850003cb0 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8541a06f0 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850035070 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.220+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8541a6eb0 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.221+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85406b860 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.223+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe850042030 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.223+0000 7fe84b7fe640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 0x7fe8400b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.223+0000 7fe859ccc640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 0x7fe8400b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.223+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe850107860 con 0x7fe8541020c0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.224+0000 7fe859ccc640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 0x7fe8400b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe844005fd0 tx=0x7fe844005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:31.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.228+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8500ce080 con 0x7fe8541020c0 2024-09-21T00:45:31.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.455+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe85410bba0 con 0x7fe8541020c0 2024-09-21T00:45:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.456+0000 7fe84b7fe640 1 -- 172.21.15.16:0/3868207125 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fe8500d2460 con 0x7fe8541020c0 2024-09-21T00:45:31.458 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:31.459 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:45:31.459 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:45:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 msgr2=0x7fe8400b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 0x7fe8400b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe844005fd0 tx=0x7fe844005e20 comp rx=0 tx=0).stop 2024-09-21T00:45:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 msgr2=0x7fe85419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe8500042f0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 shutdown_connections 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe8400b65a0 0x7fe8400b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe854106c00 0x7fe85419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8541062b0 0x7fe85419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 --2- 172.21.15.16:0/3868207125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8541020c0 0x7fe85419a4f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 >> 172.21.15.16:0/3868207125 conn(0x7fe854079e40 msgr2=0x7fe854108110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 shutdown_connections 2024-09-21T00:45:31.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:31.459+0000 7fe85c731640 1 -- 172.21.15.16:0/3868207125 wait complete. 2024-09-21T00:45:32.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:31 smithi016 ceph-mon[30947]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:32.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:31 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3868207125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:32.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:45:32.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:31 smithi123 ceph-mon[34853]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:32.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:31 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3868207125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:32.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:31 smithi178 ceph-mon[34888]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:31 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3868207125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3247387960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c41094a0 msgr2=0x7fd9c41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3247387960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c41094a0 0x7fd9c41098b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009900 tx=0x7fd9b802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3247387960 shutdown_connections 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3247387960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 0x7fd9c4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3247387960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c41094a0 0x7fd9c41098b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3247387960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c4103b60 0x7fd9c4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3247387960 >> 172.21.15.16:0/3247387960 conn(0x7fd9c407b850 msgr2=0x7fd9c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3247387960 shutdown_connections 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.896+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3247387960 wait complete. 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 Processor -- start 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 -- start start 2024-09-21T00:45:32.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c41094a0 0x7fd9c419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 0x7fd9c419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c4113ab0 con 0x7fd9c4103b60 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c4113930 con 0x7fd9c4109df0 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9ca33c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c4113c30 con 0x7fd9c41094a0 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.897+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52718/0 (socket says 172.21.15.16:52718) 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 -- 172.21.15.16:0/3165373385 learned_addr learned my addr 172.21.15.16:0/3165373385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c37fe640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c41094a0 0x7fd9c419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c88d9640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 0x7fd9c419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 -- 172.21.15.16:0/3165373385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c41094a0 msgr2=0x7fd9c419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c41094a0 0x7fd9c419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:32.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 -- 172.21.15.16:0/3165373385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 msgr2=0x7fd9c419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 0x7fd9c419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 -- 172.21.15.16:0/3165373385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c41a0430 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c3fff640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9f0 tx=0x7fd9b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400cd80 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c41a0720 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b40108e0 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4018980 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.898+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c41a6e80 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.899+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c4103f70 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.901+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fd9b4010430 con 0x7fd9c4103b60 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.902+0000 7fd9c17fa640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 0x7fd9ac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.902+0000 7fd9c37fe640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 0x7fd9ac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:32.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.902+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd9b40e7c10 con 0x7fd9c4103b60 2024-09-21T00:45:32.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.903+0000 7fd9c37fe640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 0x7fd9ac0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009230 tx=0x7fd9b8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:32.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:32.905+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9b40ae430 con 0x7fd9c4103b60 2024-09-21T00:45:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.135+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c419b5f0 con 0x7fd9c4103b60 2024-09-21T00:45:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.136+0000 7fd9c17fa640 1 -- 172.21.15.16:0/3165373385 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fd9b40b2810 con 0x7fd9c4103b60 2024-09-21T00:45:33.138 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:33.138 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:45:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:45:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 msgr2=0x7fd9ac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 0x7fd9ac0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009230 tx=0x7fd9b8031400 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 msgr2=0x7fd9c419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9f0 tx=0x7fd9b400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 shutdown_connections 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd9ac0b65a0 0x7fd9ac0b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9c4109df0 0x7fd9c419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9c41094a0 0x7fd9c419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 --2- 172.21.15.16:0/3165373385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9c4103b60 0x7fd9c419a4c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 >> 172.21.15.16:0/3165373385 conn(0x7fd9c407b850 msgr2=0x7fd9c4105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 shutdown_connections 2024-09-21T00:45:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:33.138+0000 7fd9ca33c640 1 -- 172.21.15.16:0/3165373385 wait complete. 2024-09-21T00:45:33.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:45:34.114 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:33 smithi016 ceph-mon[30947]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:33 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3165373385' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:33 smithi123 ceph-mon[34853]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:33 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3165373385' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:33 smithi178 ceph-mon[34888]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:33 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3165373385' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 -- 172.21.15.16:0/2920755776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0141094b0 msgr2=0x7fd0141098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 --2- 172.21.15.16:0/2920755776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0141094b0 0x7fd0141098c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009900 tx=0x7fcffc02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 -- 172.21.15.16:0/2920755776 shutdown_connections 2024-09-21T00:45:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 --2- 172.21.15.16:0/2920755776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014109e00 0x7fd014110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 --2- 172.21.15.16:0/2920755776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0141094b0 0x7fd0141098c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 --2- 172.21.15.16:0/2920755776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd014103bc0 0x7fd014103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 -- 172.21.15.16:0/2920755776 >> 172.21.15.16:0/2920755776 conn(0x7fd01407b910 msgr2=0x7fd01407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 -- 172.21.15.16:0/2920755776 shutdown_connections 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.627+0000 7fd019116640 1 -- 172.21.15.16:0/2920755776 wait complete. 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 Processor -- start 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 -- start start 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014103bc0 0x7fd01419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0141094b0 0x7fd01419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd014113ac0 con 0x7fd014109e00 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd014113940 con 0x7fd014103bc0 2024-09-21T00:45:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd019116640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd014113c40 con 0x7fd0141094b0 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.628+0000 7fd01359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51316/0 (socket says 172.21.15.16:51316) 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 -- 172.21.15.16:0/3530146084 learned_addr learned my addr 172.21.15.16:0/3530146084 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01259c640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0141094b0 0x7fd01419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd012d9d640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014103bc0 0x7fd01419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 -- 172.21.15.16:0/3530146084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0141094b0 msgr2=0x7fd01419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0141094b0 0x7fd01419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 -- 172.21.15.16:0/3530146084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014103bc0 msgr2=0x7fd01419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014103bc0 0x7fd01419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 -- 172.21.15.16:0/3530146084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0141a0440 con 0x7fd014109e00 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd01359e640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd00400cad0 tx=0x7fd00400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400ae20 con 0x7fd014109e00 2024-09-21T00:45:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0141a0730 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd004005020 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400f6b0 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.629+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0141a6e90 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.630+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd014103fd0 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.633+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fd0040051d0 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.634+0000 7fd00bfff640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 0x7fd0000b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.634+0000 7fd012d9d640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 0x7fd0000b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.634+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd0040e7830 con 0x7fd014109e00 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.634+0000 7fd012d9d640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 0x7fd0000b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd00c005fd0 tx=0x7fd00c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.637+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd004014030 con 0x7fd014109e00 2024-09-21T00:45:34.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.826+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd01402e640 con 0x7fd014109e00 2024-09-21T00:45:34.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.828+0000 7fd00bfff640 1 -- 172.21.15.16:0/3530146084 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7fd0040b2330 con 0x7fd014109e00 2024-09-21T00:45:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:34.831 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:45:34.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 msgr2=0x7fd0000b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 0x7fd0000b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd00c005fd0 tx=0x7fd00c00b390 comp rx=0 tx=0).stop 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 msgr2=0x7fd01419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd00400cad0 tx=0x7fd00400cf90 comp rx=0 tx=0).stop 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 shutdown_connections 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0000b65a0 0x7fd0000b8ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd014109e00 0x7fd01419fd10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0141094b0 0x7fd01419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 --2- 172.21.15.16:0/3530146084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd014103bc0 0x7fd01419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:34.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 >> 172.21.15.16:0/3530146084 conn(0x7fd01407b910 msgr2=0x7fd014105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:34.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 shutdown_connections 2024-09-21T00:45:34.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:34.830+0000 7fd019116640 1 -- 172.21.15.16:0/3530146084 wait complete. 2024-09-21T00:45:35.208 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:34 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3530146084' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:45:35.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:34 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3530146084' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:45:35.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:34 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3530146084' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:45:35.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:45:35.812 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:36.238 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:35 smithi016 ceph-mon[30947]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:35 smithi123 ceph-mon[34853]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:36.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:35 smithi178 ceph-mon[34888]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:36.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 -- 172.21.15.16:0/603010227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1481083b0 msgr2=0x7fc1481087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:36.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 --2- 172.21.15.16:0/603010227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1481083b0 0x7fc1481087c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009900 tx=0x7fc13c02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:36.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 -- 172.21.15.16:0/603010227 shutdown_connections 2024-09-21T00:45:36.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 --2- 172.21.15.16:0/603010227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148108d00 0x7fc14810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 --2- 172.21.15.16:0/603010227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1481083b0 0x7fc1481087c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 --2- 172.21.15.16:0/603010227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc148102a70 0x7fc148102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 -- 172.21.15.16:0/603010227 >> 172.21.15.16:0/603010227 conn(0x7fc148079730 msgr2=0x7fc148079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 -- 172.21.15.16:0/603010227 shutdown_connections 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.327+0000 7fc14cf40640 1 -- 172.21.15.16:0/603010227 wait complete. 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 Processor -- start 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 -- start start 2024-09-21T00:45:36.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148102a70 0x7fc14819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1481083b0 0x7fc14819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc148112970 con 0x7fc148108d00 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc1481127f0 con 0x7fc1481083b0 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14cf40640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc148112af0 con 0x7fc148102a70 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc146d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc146d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51342/0 (socket says 172.21.15.16:51342) 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc146d9d640 1 -- 172.21.15.16:0/2798561835 learned_addr learned my addr 172.21.15.16:0/2798561835 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc145d9b640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1481083b0 0x7fc14819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.328+0000 7fc14659c640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148102a70 0x7fc14819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 -- 172.21.15.16:0/2798561835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148102a70 msgr2=0x7fc14819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148102a70 0x7fc14819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 -- 172.21.15.16:0/2798561835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1481083b0 msgr2=0x7fc14819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1481083b0 0x7fc14819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 -- 172.21.15.16:0/2798561835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1481a65f0 con 0x7fc148108d00 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc146d9d640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d750 tx=0x7fc14000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc148108d00 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1481a68e0 con 0x7fc148108d00 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1400054d0 con 0x7fc148108d00 2024-09-21T00:45:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140004c60 con 0x7fc148108d00 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.329+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1481a6e40 con 0x7fc148108d00 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.330+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc148103cf0 con 0x7fc148108d00 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.333+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc140009bd0 con 0x7fc148108d00 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.334+0000 7fc1377fe640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 0x7fc1300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.334+0000 7fc14659c640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 0x7fc1300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.334+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc1400e7100 con 0x7fc148108d00 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.334+0000 7fc14659c640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 0x7fc1300b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc138007350 tx=0x7fc1380072e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.337+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1400ad920 con 0x7fc148108d00 2024-09-21T00:45:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.563+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14810ab20 con 0x7fc148108d00 2024-09-21T00:45:36.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.563+0000 7fc1377fe640 1 -- 172.21.15.16:0/2798561835 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fc1400b1d00 con 0x7fc148108d00 2024-09-21T00:45:36.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:36.566 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:45:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.565+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 msgr2=0x7fc1300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.565+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 0x7fc1300b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc138007350 tx=0x7fc1380072e0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.565+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 msgr2=0x7fc14819be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.565+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d750 tx=0x7fc14000dc10 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 shutdown_connections 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc1300b65a0 0x7fc1300b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc148108d00 0x7fc14819be40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1481083b0 0x7fc14819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 --2- 172.21.15.16:0/2798561835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc148102a70 0x7fc14819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 >> 172.21.15.16:0/2798561835 conn(0x7fc148079730 msgr2=0x7fc148104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 shutdown_connections 2024-09-21T00:45:36.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:36.566+0000 7fc14cf40640 1 -- 172.21.15.16:0/2798561835 wait complete. 2024-09-21T00:45:37.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:44:18.388808+0000', 'modified': '2024-09-21T00:44:30.753465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24677, 'mds_1': 24644, 'mds_2': 24625, 'mds_3': 24620, 'mds_4': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14778': {'gid': 14778, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6839/3052513368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6838', 'nonce': 3052513368}, {'type': 'v1', 'addr': '172.21.15.16:6839', 'nonce': 3052513368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14790': {'gid': 14790, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6841/1186818130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6840', 'nonce': 1186818130}, {'type': 'v1', 'addr': '172.21.15.16:6841', 'nonce': 1186818130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/2278158780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 2278158780}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 2278158780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24587': {'gid': 24587, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6833/2611682237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6832', 'nonce': 2611682237}, {'type': 'v1', 'addr': '172.21.15.123:6833', 'nonce': 2611682237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/4194574330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 4194574330}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 4194574330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.178:6837/795211231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 795211231}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 795211231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.123:6835/1315446944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1315446944}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1315446944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.178:6839/3738575776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 3738575776}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 3738575776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24644': {'gid': 24644, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.123:6837/2648060982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2648060982}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2648060982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24677': {'gid': 24677, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/760564744', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 760564744}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 760564744}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24677, 'qdb_cluster': [24644, 24677, 24625, 24620, 24613]} 2024-09-21T00:45:37.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T00:45:37.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T00:45:37.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:36 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2798561835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:37.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:36 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2798561835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:37.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:36 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2798561835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:37.485 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:38.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 -- 172.21.15.16:0/2151575267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 msgr2=0x7f3550110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 --2- 172.21.15.16:0/2151575267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f3550110620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3548009ca0 tx=0x7f354802a8e0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 -- 172.21.15.16:0/2151575267 shutdown_connections 2024-09-21T00:45:38.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 --2- 172.21.15.16:0/2151575267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f3550110620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 --2- 172.21.15.16:0/2151575267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35501094a0 0x7f35501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 --2- 172.21.15.16:0/2151575267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3550103b60 0x7f3550103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 -- 172.21.15.16:0/2151575267 >> 172.21.15.16:0/2151575267 conn(0x7f355007b850 msgr2=0x7f355007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 -- 172.21.15.16:0/2151575267 shutdown_connections 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.005+0000 7f3557779640 1 -- 172.21.15.16:0/2151575267 wait complete. 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.006+0000 7f3557779640 1 Processor -- start 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.006+0000 7f3557779640 1 -- start start 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.006+0000 7f3557779640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3550103b60 0x7f355019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.006+0000 7f3557779640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 0x7f355019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3557779640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3557779640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3550113af0 con 0x7f3550109df0 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3557779640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3550113970 con 0x7f35501094a0 2024-09-21T00:45:38.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3557779640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3550113c70 con 0x7f3550103b60 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51366/0 (socket says 172.21.15.16:51366) 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 -- 172.21.15.16:0/3348275735 learned_addr learned my addr 172.21.15.16:0/3348275735 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555515640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3550103b60 0x7f355019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3554d14640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 0x7f355019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 -- 172.21.15.16:0/3348275735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3550103b60 msgr2=0x7f355019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3550103b60 0x7f355019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 -- 172.21.15.16:0/3348275735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 msgr2=0x7f355019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 0x7f355019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 -- 172.21.15.16:0/3348275735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35501a0450 con 0x7f3550109df0 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3554d14640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 0x7f355019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3555d16640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3548005cc0 tx=0x7f35480039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f35467fc640 1 -- 172.21.15.16:0/3348275735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548003de0 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f35467fc640 1 -- 172.21.15.16:0/3348275735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35480044f0 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f35467fc640 1 -- 172.21.15.16:0/3348275735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548030d90 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.007+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35501a06e0 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.008+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a6ea0 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.010+0000 7f35467fc640 1 -- 172.21.15.16:0/3348275735 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3548004040 con 0x7f3550109df0 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.010+0000 7f355dced740 1 Processor -- start 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.010+0000 7f355dced740 1 -- start start 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 0x5619c673a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c673a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5619c66b1c10 con 0x5619c6393f60 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5619c66a1040 con 0x5619c6373280 2024-09-21T00:45:38.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f355dced740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5619c66a4e50 con 0x5619c636b0a0 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51382/0 (socket says 172.21.15.16:51382) 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 -- 172.21.15.16:0/931945407 learned_addr learned my addr 172.21.15.16:0/931945407 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3555515640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 0x5619c673a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c673a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f35467fc640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 0x7f353c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 -- 172.21.15.16:0/931945407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 msgr2=0x5619c673a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 0x5619c673a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 -- 172.21.15.16:0/931945407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 msgr2=0x5619c673a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c673a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 -- 172.21.15.16:0/931945407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c63ff540 con 0x5619c6393f60 2024-09-21T00:45:38.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3555d16640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 0x7f353c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3555515640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 0x5619c673a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f3554d14640 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3540007ba0 tx=0x7f35400073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91805f223fcc8844 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.011+0000 7f35467fc640 1 -- 172.21.15.16:0/3348275735 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f3548108840 con 0x7f3550109df0 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.012+0000 7f353b7fe640 1 -- 172.21.15.16:0/931945407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354001a070 con 0x5619c6393f60 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.012+0000 7f353b7fe640 1 -- 172.21.15.16:0/931945407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3540010040 con 0x5619c6393f60 2024-09-21T00:45:38.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.012+0000 7f353b7fe640 1 -- 172.21.15.16:0/931945407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540014610 con 0x5619c6393f60 2024-09-21T00:45:38.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- 172.21.15.16:0/931945407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 msgr2=0x5619c6739f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f3555d16640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 0x7f353c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f35480ce660 tx=0x7f354802a8e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3540007ba0 tx=0x7f35400073c0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- 172.21.15.16:0/931945407 shutdown_connections 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c673a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c636b0a0 0x5619c673a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 --2- 172.21.15.16:0/931945407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6739f00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- 172.21.15.16:0/931945407 >> 172.21.15.16:0/931945407 conn(0x5619c6388350 msgr2=0x5619c6737df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- 172.21.15.16:0/931945407 shutdown_connections 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- 172.21.15.16:0/931945407 wait complete. 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 -- start start 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.013+0000 7f355dced740 1 Processor -- start 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c636b0a0 0x5619c67459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6373280 0x5619c6745f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5619c65025f0 con 0x5619c6393f60 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5619c663c010 con 0x5619c636b0a0 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5619c67486e0 con 0x5619c6373280 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f355dced740 10 client.0 _ll_register_callbacks cb 0x5619c669b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51390/0 (socket says 172.21.15.16:51390) 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 -- 172.21.15.16:0/3108715256 learned_addr learned my addr 172.21.15.16:0/3108715256 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3555515640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6373280 0x5619c6745f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c636b0a0 0x5619c67459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 -- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6373280 msgr2=0x5619c6745f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6373280 0x5619c6745f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 -- 172.21.15.16:0/3108715256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c636b0a0 msgr2=0x5619c67459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c636b0a0 0x5619c67459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.014+0000 7f3554d14640 1 -- 172.21.15.16:0/3108715256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c6669a00 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3554d14640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3540015dd0 tx=0x7f3540015cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109136ff191ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354002a060 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f3540005bc0 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3540010040 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f354001a070 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f355dced740 10 client.15156 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619c6754600 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3540010040 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.015+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f354002e020 con 0x5619c6393f60 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 10 client.15156 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 10 client.15156 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 20 client.15156 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c63528e0 0x5619c6757d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 4 client.15156 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619c66b3b60 con 0x5619c63528e0 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f3555515640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c63528e0 0x5619c6757d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f3555515640 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c63528e0 0x5619c6757d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=19954cdc4b7d6922 server_cookie=5b6027699df806f8 in_seq=0 out_seq=0 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.016+0000 7f3538ff9640 10 client.15156 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f3538ff9640 1 -- 172.21.15.16:0/3108715256 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619c66b3b60 con 0x5619c63528e0 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f3538ff9640 10 client.15156 handle_command_reply: tid=0 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f355dced740 1 client.15156 shutdown 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 msgr2=0x5619c6751a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3540015dd0 tx=0x7f3540015cd0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.017+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 shutdown_connections 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c63528e0 0x5619c6757d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c6393f60 0x5619c6751a00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6373280 0x5619c6745f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 --2- 172.21.15.16:0/3108715256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c636b0a0 0x5619c67459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 >> 172.21.15.16:0/3108715256 conn(0x5619c6388350 msgr2=0x5619c673d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f3538ff9640 0 client.15156 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 shutdown_connections 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 1 -- 172.21.15.16:0/3108715256 wait complete. 2024-09-21T00:45:38.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.018+0000 7f355dced740 20 client.15156 trim_cache size 0 max 16384 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 Processor -- start 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 -- start start 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6751970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c6751eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5619c67560c0 con 0x5619c636b0a0 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5619c6756790 con 0x5619c6373280 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f355dced740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5619c6756e60 con 0x5619c6393f60 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51392/0 (socket says 172.21.15.16:51392) 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.036+0000 7f3554d14640 1 -- 172.21.15.16:0/2911299002 learned_addr learned my addr 172.21.15.16:0/2911299002 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3555515640 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6751970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 -- 172.21.15.16:0/2911299002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 msgr2=0x5619c6751eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c6751eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 -- 172.21.15.16:0/2911299002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 msgr2=0x5619c6751970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6751970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 -- 172.21.15.16:0/2911299002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c673c420 con 0x5619c636b0a0 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f3554d14640 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3540000c00 tx=0x7f35400069a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e7e99e6d95f963 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f353affd640 1 -- 172.21.15.16:0/2911299002 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35400158d0 con 0x5619c636b0a0 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f353affd640 1 -- 172.21.15.16:0/2911299002 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f354001b040 con 0x5619c636b0a0 2024-09-21T00:45:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.037+0000 7f353affd640 1 -- 172.21.15.16:0/2911299002 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540006260 con 0x5619c636b0a0 2024-09-21T00:45:38.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- 172.21.15.16:0/2911299002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 msgr2=0x5619c6740020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3540000c00 tx=0x7f35400069a0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- 172.21.15.16:0/2911299002 shutdown_connections 2024-09-21T00:45:38.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c6751eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6751970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 --2- 172.21.15.16:0/2911299002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c6740020 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- 172.21.15.16:0/2911299002 >> 172.21.15.16:0/2911299002 conn(0x5619c6388350 msgr2=0x5619c67459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- 172.21.15.16:0/2911299002 shutdown_connections 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- 172.21.15.16:0/2911299002 wait complete. 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 -- start start 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.038+0000 7f355dced740 1 Processor -- start 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6759a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c67c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5619c6757c00 con 0x5619c636b0a0 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5619c6757530 con 0x5619c6373280 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5619c67582d0 con 0x5619c6393f60 2024-09-21T00:45:38.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f355dced740 10 client.0 _ll_register_callbacks cb 0x7f3540018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51404/0 (socket says 172.21.15.16:51404) 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 -- 172.21.15.16:0/2840269456 learned_addr learned my addr 172.21.15.16:0/2840269456 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3555515640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6759a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c67c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 -- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 msgr2=0x5619c67c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c67c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 -- 172.21.15.16:0/2840269456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 msgr2=0x5619c6759a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6759a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.039+0000 7f3554d14640 1 -- 172.21.15.16:0/2840269456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c67c1780 con 0x5619c636b0a0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3554d14640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3540007ba0 tx=0x7f3540030460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35b632c3c53fee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540006200 con 0x5619c636b0a0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f35400063a0 con 0x5619c636b0a0 2024-09-21T00:45:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354001b040 con 0x5619c636b0a0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35400076f0 con 0x5619c636b0a0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f355dced740 10 client.15162 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619c67c28d0 con 0x5619c636b0a0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f354001b040 con 0x5619c636b0a0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f354002e070 con 0x5619c636b0a0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f355dced740 10 client.15162 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.040+0000 7f355dced740 10 client.15162 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f355dced740 20 client.15162 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c6327c90 0x5619c67c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f355dced740 4 client.15162 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "status"}) -- 0x5619c66af610 con 0x5619c6327c90 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f3555515640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c6327c90 0x5619c67c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f3555515640 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c6327c90 0x5619c67c5de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=72e51f01f51abaad server_cookie=423d36f778d3d496 in_seq=0 out_seq=0 2024-09-21T00:45:38.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.041+0000 7f3538ff9640 10 client.15162 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:45:38.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f3538ff9640 1 -- 172.21.15.16:0/2840269456 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5619c66af610 con 0x5619c6327c90 2024-09-21T00:45:38.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f3538ff9640 10 client.15162 handle_command_reply: tid=0 2024-09-21T00:45:38.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 client.15162 shutdown 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 msgr2=0x5619c67594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3540007ba0 tx=0x7f3540030460 comp rx=0 tx=0).stop 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 shutdown_connections 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5619c6327c90 0x5619c67c5de0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5619c6393f60 0x5619c67c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5619c6373280 0x5619c6759a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 --2- 172.21.15.16:0/2840269456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5619c636b0a0 0x5619c67594a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f3538ff9640 0 client.15162 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 >> 172.21.15.16:0/2840269456 conn(0x5619c6388350 msgr2=0x5619c6737600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 shutdown_connections 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 1 -- 172.21.15.16:0/2840269456 wait complete. 2024-09-21T00:45:38.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.042+0000 7f355dced740 20 client.15162 trim_cache size 0 max 16384 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 4, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24613, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 68.300871231000002, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 105.35535526300001 2024-09-21T00:45:38.049 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 msgr2=0x7f353c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 0x7f353c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f35480ce660 tx=0x7f354802a8e0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 msgr2=0x7f355019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3548005cc0 tx=0x7f35480039f0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 shutdown_connections 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f353c0b65a0 0x7f353c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3550109df0 0x7f355019fd20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35501094a0 0x7f355019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 --2- 172.21.15.16:0/3348275735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3550103b60 0x7f355019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:38.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 >> 172.21.15.16:0/3348275735 conn(0x7f355007b850 msgr2=0x7f3550107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:38.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 shutdown_connections 2024-09-21T00:45:38.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:38.043+0000 7f3557779640 1 -- 172.21.15.16:0/3348275735 wait complete. 2024-09-21T00:45:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:37 smithi016 ceph-mon[30947]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:37 smithi123 ceph-mon[34853]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:38.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:37 smithi178 ceph-mon[34888]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:38.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.e status 2024-09-21T00:45:39.104 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 -- 172.21.15.16:0/1840431058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 msgr2=0x7f460c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 --2- 172.21.15.16:0/1840431058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c102e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4608009900 tx=0x7f460802a410 comp rx=0 tx=0).stop 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 -- 172.21.15.16:0/1840431058 shutdown_connections 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 --2- 172.21.15.16:0/1840431058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c108d10 0x7f460c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 --2- 172.21.15.16:0/1840431058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c1083c0 0x7f460c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 --2- 172.21.15.16:0/1840431058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c102e90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 -- 172.21.15.16:0/1840431058 >> 172.21.15.16:0/1840431058 conn(0x7f460c079740 msgr2=0x7f460c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 -- 172.21.15.16:0/1840431058 shutdown_connections 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 -- 172.21.15.16:0/1840431058 wait complete. 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.741+0000 7f4613e12640 1 Processor -- start 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 -- start start 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c1083c0 0x7f460c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c108d10 0x7f460c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112980 con 0x7f460c102a80 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112800 con 0x7f460c108d10 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4613e12640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112b00 con 0x7f460c1083c0 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51424/0 (socket says 172.21.15.16:51424) 2024-09-21T00:45:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 -- 172.21.15.16:0/528661819 learned_addr learned my addr 172.21.15.16:0/528661819 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f46113ad640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c1083c0 0x7f460c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f46123af640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c108d10 0x7f460c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 -- 172.21.15.16:0/528661819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c1083c0 msgr2=0x7f460c199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c1083c0 0x7f460c199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 -- 172.21.15.16:0/528661819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c108d10 msgr2=0x7f460c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c108d10 0x7f460c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.742+0000 7f4611bae640 1 -- 172.21.15.16:0/528661819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c19f240 con 0x7f460c102a80 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4611bae640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4608005940 tx=0x7f4608004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4602ffd640 1 -- 172.21.15.16:0/528661819 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460803f030 con 0x7f460c102a80 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c19f4d0 con 0x7f460c102a80 2024-09-21T00:45:39.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4602ffd640 1 -- 172.21.15.16:0/528661819 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4608003aa0 con 0x7f460c102a80 2024-09-21T00:45:39.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4602ffd640 1 -- 172.21.15.16:0/528661819 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608035070 con 0x7f460c102a80 2024-09-21T00:45:39.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.743+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c19fa00 con 0x7f460c102a80 2024-09-21T00:45:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.745+0000 7f461a386740 1 Processor -- start 2024-09-21T00:45:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 -- start start 2024-09-21T00:45:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f4602ffd640 1 -- 172.21.15.16:0/528661819 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4608042030 con 0x7f460c102a80 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d263f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d264980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559d5d1dbc10 con 0x559d5ce950a0 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d5d1cb040 con 0x559d5cebdf60 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f461a386740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559d5d1cee50 con 0x559d5ce9d280 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51434/0 (socket says 172.21.15.16:51434) 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f4611bae640 1 -- 172.21.15.16:0/284654574 learned_addr learned my addr 172.21.15.16:0/284654574 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:39.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f46123af640 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d263f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.746+0000 7f46113ad640 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d264980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 -- 172.21.15.16:0/284654574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 msgr2=0x559d5d264980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d264980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 -- 172.21.15.16:0/284654574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 msgr2=0x559d5d263f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d263f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 -- 172.21.15.16:0/284654574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5cf29540 con 0x559d5ce950a0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4602ffd640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 0x7f45f80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4611bae640 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f460810bd10 tx=0x7f460810be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dac0344f98ccce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f46123af640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 0x7f45f80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f4602ffd640 1 -- 172.21.15.16:0/528661819 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f4608107a70 con 0x7f460c102a80 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f45f7fff640 1 -- 172.21.15.16:0/284654574 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46080ca1e0 con 0x559d5ce950a0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f45f7fff640 1 -- 172.21.15.16:0/284654574 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460810c040 con 0x559d5ce950a0 2024-09-21T00:45:39.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.747+0000 7f45f7fff640 1 -- 172.21.15.16:0/284654574 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46080cd300 con 0x559d5ce950a0 2024-09-21T00:45:39.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 -- 172.21.15.16:0/284654574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 msgr2=0x559d5d264440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f46123af640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 0x7f45f80b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4604005fd0 tx=0x7f4604009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f460810bd10 tx=0x7f460810be00 comp rx=0 tx=0).stop 2024-09-21T00:45:39.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 -- 172.21.15.16:0/284654574 shutdown_connections 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d264980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d264440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 --2- 172.21.15.16:0/284654574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d263f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 -- 172.21.15.16:0/284654574 >> 172.21.15.16:0/284654574 conn(0x559d5ceb2350 msgr2=0x559d5d261df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 -- 172.21.15.16:0/284654574 shutdown_connections 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.748+0000 7f461a386740 1 -- 172.21.15.16:0/284654574 wait complete. 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 -- start start 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 Processor -- start 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d271970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d27d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559d5d02c5f0 con 0x559d5ce9d280 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d5d166010 con 0x559d5cebdf60 2024-09-21T00:45:39.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559d5d2745d0 con 0x559d5ce950a0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f461a386740 10 client.0 _ll_register_callbacks cb 0x559d5d1c5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.749+0000 7f46113ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51444/0 (socket says 172.21.15.16:51444) 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 -- 172.21.15.16:0/2794116811 learned_addr learned my addr 172.21.15.16:0/2794116811 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f4611bae640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d271970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46123af640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d27d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 -- 172.21.15.16:0/2794116811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 msgr2=0x559d5d271970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d271970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 -- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 msgr2=0x559d5d27d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d27d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 -- 172.21.15.16:0/2794116811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5d193a00 con 0x559d5ce9d280 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f46113ad640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f45fc012770 tx=0x7f45fc012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e438b79b7e5d61af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f45f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc01f060 con 0x559d5ce9d280 2024-09-21T00:45:39.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f45fc010d60 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460810c040 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f45fc01a430 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.750+0000 7f461a386740 10 client.15174 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559d5d280420 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460810c040 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f45fc00e4b0 con 0x559d5ce9d280 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 10 client.15174 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 10 client.15174 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 20 client.15174 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce7c8e0 0x559d5d283ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 4 client.15174 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d5d1ddb60 con 0x559d5ce7c8e0 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.751+0000 7f4611bae640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce7c8e0 0x559d5d283ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.752+0000 7f45f57fa640 10 client.15174 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.752+0000 7f4611bae640 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce7c8e0 0x559d5d283ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b39d779effbdb664 server_cookie=55299c2ce8f40d5 in_seq=0 out_seq=0 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f45f57fa640 1 -- 172.21.15.16:0/2794116811 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d5d1ddb60 con 0x559d5ce7c8e0 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f45f57fa640 10 client.15174 handle_command_reply: tid=0 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 client.15174 shutdown 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 msgr2=0x559d5d271f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f45fc012770 tx=0x7f45fc012c30 comp rx=0 tx=0).stop 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 shutdown_connections 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce7c8e0 0x559d5d283ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d27d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce9d280 0x559d5d271f50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f45f57fa640 0 client.15174 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 --2- 172.21.15.16:0/2794116811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d271970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 >> 172.21.15.16:0/2794116811 conn(0x559d5ceb2350 msgr2=0x559d5d267050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 shutdown_connections 2024-09-21T00:45:39.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 1 -- 172.21.15.16:0/2794116811 wait complete. 2024-09-21T00:45:39.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.753+0000 7f461a386740 20 client.15174 trim_cache size 0 max 16384 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 Processor -- start 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 -- start start 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d2701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 0x559d5d270730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559d5d282210 con 0x559d5cebdf60 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d5d2828e0 con 0x559d5ce9d280 2024-09-21T00:45:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f461a386740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559d5d282fb0 con 0x559d5ce950a0 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f46123af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f46123af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51458/0 (socket says 172.21.15.16:51458) 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.774+0000 7f46123af640 1 -- 172.21.15.16:0/4159625381 learned_addr learned my addr 172.21.15.16:0/4159625381 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f4611bae640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d2701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46113ad640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 0x559d5d270730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 -- 172.21.15.16:0/4159625381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 msgr2=0x559d5d2701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d2701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 -- 172.21.15.16:0/4159625381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 msgr2=0x559d5d270730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 0x559d5d270730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 -- 172.21.15.16:0/4159625381 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5d267fb0 con 0x559d5cebdf60 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46113ad640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 0x559d5d270730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f46123af640 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4604012550 tx=0x7f4604015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba454f084f7cfe37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f45f77fe640 1 -- 172.21.15.16:0/4159625381 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460401b510 con 0x559d5cebdf60 2024-09-21T00:45:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f45f77fe640 1 -- 172.21.15.16:0/4159625381 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460401bb60 con 0x559d5cebdf60 2024-09-21T00:45:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.775+0000 7f45f77fe640 1 -- 172.21.15.16:0/4159625381 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604010b10 con 0x559d5cebdf60 2024-09-21T00:45:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- 172.21.15.16:0/4159625381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 msgr2=0x559d5d261600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4604012550 tx=0x7f4604015000 comp rx=0 tx=0).stop 2024-09-21T00:45:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- 172.21.15.16:0/4159625381 shutdown_connections 2024-09-21T00:45:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5cebdf60 0x559d5d261600 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5ce9d280 0x559d5d270730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 --2- 172.21.15.16:0/4159625381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce950a0 0x559d5d2701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- 172.21.15.16:0/4159625381 >> 172.21.15.16:0/4159625381 conn(0x559d5ceb2350 msgr2=0x559d5d26cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- 172.21.15.16:0/4159625381 shutdown_connections 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- 172.21.15.16:0/4159625381 wait complete. 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.776+0000 7f461a386740 1 -- start start 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 Processor -- start 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d28cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d286ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559d5d283d50 con 0x559d5ce950a0 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d5d283680 con 0x559d5cebdf60 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559d5d284420 con 0x559d5ce9d280 2024-09-21T00:45:39.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f4611bae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51470/0 (socket says 172.21.15.16:51470) 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f4611bae640 1 -- 172.21.15.16:0/4100586312 learned_addr learned my addr 172.21.15.16:0/4100586312 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f461a386740 10 client.0 _ll_register_callbacks cb 0x7f45fc00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f46123af640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d286ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.777+0000 7f46113ad640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d28cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 -- 172.21.15.16:0/4100586312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 msgr2=0x559d5d28cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d28cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 -- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 msgr2=0x559d5d286ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d286ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 -- 172.21.15.16:0/4100586312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5d287330 con 0x559d5ce950a0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f46113ad640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d28cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f4611bae640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46080ca160 tx=0x7f4608005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740c55e2db85bbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f45f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608049040 con 0x559d5ce950a0 2024-09-21T00:45:39.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f460810b860 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460401bb60 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46080cd4e0 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f461a386740 10 client.15180 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559d5d2efdd0 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.778+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460401bb60 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f46080f10c0 con 0x559d5ce950a0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 10 client.15180 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 10 client.15180 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 20 client.15180 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce51c90 0x559d5d2f3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 4 client.15180 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "status"}) -- 0x559d5d1d9610 con 0x559d5ce51c90 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f46113ad640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce51c90 0x559d5d2f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f46113ad640 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce51c90 0x559d5d2f3520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ffcda73a2e2f12f server_cookie=bd056cf06a535e19 in_seq=0 out_seq=0 2024-09-21T00:45:39.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.779+0000 7f45f57fa640 10 client.15180 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f45f57fa640 1 -- 172.21.15.16:0/4100586312 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559d5d1d9610 con 0x559d5ce51c90 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f45f57fa640 10 client.15180 handle_command_reply: tid=0 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 client.15180 shutdown 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 msgr2=0x559d5d28c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46080ca160 tx=0x7f4608005c90 comp rx=0 tx=0).stop 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 shutdown_connections 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x559d5ce51c90 0x559d5d2f3520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d5cebdf60 0x559d5d286ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559d5ce9d280 0x559d5d28cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 --2- 172.21.15.16:0/4100586312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559d5ce950a0 0x559d5d28c500 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f45f57fa640 0 client.15180 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 >> 172.21.15.16:0/4100586312 conn(0x559d5ceb2350 msgr2=0x559d5d261600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 shutdown_connections 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 1 -- 172.21.15.16:0/4100586312 wait complete. 2024-09-21T00:45:39.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.780+0000 7f461a386740 20 client.15180 trim_cache size 0 max 16384 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 3, 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24620, 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 71.043902703000001, 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:45:39.786 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 112.27394800499999 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 msgr2=0x7f45f80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 0x7f45f80b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4604005fd0 tx=0x7f4604009500 comp rx=0 tx=0).stop 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 msgr2=0x7f460c199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4608005940 tx=0x7f4608004270 comp rx=0 tx=0).stop 2024-09-21T00:45:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 shutdown_connections 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45f80b65d0 0x7f45f80b8ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f460c108d10 0x7f460c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f460c1083c0 0x7f460c199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 --2- 172.21.15.16:0/528661819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f460c102a80 0x7f460c199390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 >> 172.21.15.16:0/528661819 conn(0x7f460c079740 msgr2=0x7f460c101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 shutdown_connections 2024-09-21T00:45:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:39.781+0000 7f4613e12640 1 -- 172.21.15.16:0/528661819 wait complete. 2024-09-21T00:45:40.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:39 smithi016 ceph-mon[30947]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:39 smithi123 ceph-mon[34853]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:40.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:39 smithi178 ceph-mon[34888]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:45:40.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T00:45:40.749 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 -- 172.21.15.16:0/2223888907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8334103b60 msgr2=0x7f8334103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 --2- 172.21.15.16:0/2223888907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8334103b60 0x7f8334103f70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8330009900 tx=0x7f833002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 -- 172.21.15.16:0/2223888907 shutdown_connections 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 --2- 172.21.15.16:0/2223888907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 0x7f8334110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 --2- 172.21.15.16:0/2223888907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83341094a0 0x7f83341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 --2- 172.21.15.16:0/2223888907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8334103b60 0x7f8334103f70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.239+0000 7f833ba29640 1 -- 172.21.15.16:0/2223888907 >> 172.21.15.16:0/2223888907 conn(0x7f833407b850 msgr2=0x7f833407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.240+0000 7f833ba29640 1 -- 172.21.15.16:0/2223888907 shutdown_connections 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.240+0000 7f833ba29640 1 -- 172.21.15.16:0/2223888907 wait complete. 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.240+0000 7f833ba29640 1 Processor -- start 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.240+0000 7f833ba29640 1 -- start start 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8334103b60 0x7f8334075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 0x7f8334076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8334113ab0 con 0x7f83341094a0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8334113930 con 0x7f8334103b60 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f833ba29640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8334113c30 con 0x7f8334109df0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51482/0 (socket says 172.21.15.16:51482) 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 -- 172.21.15.16:0/1644146664 learned_addr learned my addr 172.21.15.16:0/1644146664 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 0x7f8334076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f83397c5640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8334103b60 0x7f8334075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 -- 172.21.15.16:0/1644146664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 msgr2=0x7f8334076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 0x7f8334076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 -- 172.21.15.16:0/1644146664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8334103b60 msgr2=0x7f8334075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8334103b60 0x7f8334075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 -- 172.21.15.16:0/1644146664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83341a8780 con 0x7f83341094a0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f832400c970 tx=0x7f832400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.241+0000 7f832a7fc640 1 -- 172.21.15.16:0/1644146664 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324007bb0 con 0x7f83341094a0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.242+0000 7f832a7fc640 1 -- 172.21.15.16:0/1644146664 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8324007d50 con 0x7f83341094a0 2024-09-21T00:45:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.242+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83341a8a70 con 0x7f83341094a0 2024-09-21T00:45:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.242+0000 7f832a7fc640 1 -- 172.21.15.16:0/1644146664 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832400f450 con 0x7f83341094a0 2024-09-21T00:45:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.242+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83341a8fb0 con 0x7f83341094a0 2024-09-21T00:45:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 Processor -- start 2024-09-21T00:45:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 -- start start 2024-09-21T00:45:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f832a7fc640 1 -- 172.21.15.16:0/1644146664 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8324004eb0 con 0x7f83341094a0 2024-09-21T00:45:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c22cf60 0x55c66c5d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c66c54ac10 con 0x55c66c20c280 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c66c53a040 con 0x55c66c2040a0 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8341f9d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c66c53de50 con 0x55c66c22cf60 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8338fc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8338fc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51498/0 (socket says 172.21.15.16:51498) 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8338fc4640 1 -- 172.21.15.16:0/238001998 learned_addr learned my addr 172.21.15.16:0/238001998 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f8339fc6640 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c22cf60 0x55c66c5d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.245+0000 7f83397c5640 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 -- 172.21.15.16:0/238001998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c22cf60 msgr2=0x55c66c5d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c22cf60 0x55c66c5d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 -- 172.21.15.16:0/238001998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 msgr2=0x55c66c5d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 -- 172.21.15.16:0/238001998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66c298540 con 0x55c66c20c280 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8338fc4640 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f83240e4ae0 tx=0x7f83240ef880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b854b364a2bc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f832a7fc640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 0x7f83200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 0x7f83200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f831f7fe640 1 -- 172.21.15.16:0/238001998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a9870 con 0x55c66c20c280 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f832a7fc640 1 -- 172.21.15.16:0/1644146664 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f83240e7100 con 0x7f83341094a0 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f831f7fe640 1 -- 172.21.15.16:0/238001998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240acd30 con 0x55c66c20c280 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.246+0000 7f831f7fe640 1 -- 172.21.15.16:0/238001998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240b3e20 con 0x55c66c20c280 2024-09-21T00:45:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 -- 172.21.15.16:0/238001998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 msgr2=0x55c66c5d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 0x7f83200b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f832c005fd0 tx=0x7f832c009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f83240e4ae0 tx=0x7f83240ef880 comp rx=0 tx=0).stop 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 -- 172.21.15.16:0/238001998 shutdown_connections 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5d3980 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 --2- 172.21.15.16:0/238001998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c22cf60 0x55c66c5d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 -- 172.21.15.16:0/238001998 >> 172.21.15.16:0/238001998 conn(0x55c66c221350 msgr2=0x55c66c5d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 -- 172.21.15.16:0/238001998 shutdown_connections 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.247+0000 7f8341f9d740 1 -- 172.21.15.16:0/238001998 wait complete. 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 -- start start 2024-09-21T00:45:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 Processor -- start 2024-09-21T00:45:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 0x55c66c5dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c66c39b5f0 con 0x55c66c22cf60 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c66c4d5010 con 0x55c66c2040a0 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5e16e0 con 0x55c66c20c280 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.248+0000 7f8341f9d740 10 client.0 _ll_register_callbacks cb 0x55c66c534340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51510/0 (socket says 172.21.15.16:51510) 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 -- 172.21.15.16:0/1725239288 learned_addr learned my addr 172.21.15.16:0/1725239288 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 0x55c66c5dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f83397c5640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 -- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 msgr2=0x55c66c5dec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 0x55c66c5dec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 -- 172.21.15.16:0/1725239288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 msgr2=0x55c66c5de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5de6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 -- 172.21.15.16:0/1725239288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66c502a00 con 0x55c66c22cf60 2024-09-21T00:45:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 0x55c66c5dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f832c005c40 tx=0x7f832c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644fb03ec63a9cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f831cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c020620 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f832c0207c0 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.249+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83240acd30 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f832c020a00 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 10 client.15192 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c66c5ed570 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240acd30 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f832c00f040 con 0x55c66c22cf60 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 10 client.15192 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 10 client.15192 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:45:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 20 client.15192 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c1eb8e0 0x55c66c5f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 4 client.15192 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.250+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c66c54cb60 con 0x55c66c1eb8e0 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.251+0000 7f83397c5640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c1eb8e0 0x55c66c5f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.251+0000 7f83397c5640 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c1eb8e0 0x55c66c5f1050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d51a41d40949ee5c server_cookie=6bdb65b37277f744 in_seq=0 out_seq=0 2024-09-21T00:45:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.251+0000 7f831cff9640 10 client.15192 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f831cff9640 1 -- 172.21.15.16:0/1725239288 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c66c54cb60 con 0x55c66c1eb8e0 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f831cff9640 10 client.15192 handle_command_reply: tid=0 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 client.15192 shutdown 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 msgr2=0x55c66c5ea9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f832c005c40 tx=0x7f832c004a40 comp rx=0 tx=0).stop 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 shutdown_connections 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c1eb8e0 0x55c66c5f1050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c22cf60 0x55c66c5ea9d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c20c280 0x55c66c5dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f831cff9640 0 client.15192 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:45:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1725239288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c2040a0 0x55c66c5de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 >> 172.21.15.16:0/1725239288 conn(0x55c66c221350 msgr2=0x55c66c5d6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 shutdown_connections 2024-09-21T00:45:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 1 -- 172.21.15.16:0/1725239288 wait complete. 2024-09-21T00:45:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.252+0000 7f8341f9d740 20 client.15192 trim_cache size 0 max 16384 2024-09-21T00:45:41.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.270+0000 7f8341f9d740 1 Processor -- start 2024-09-21T00:45:41.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 -- start start 2024-09-21T00:45:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 0x55c66c5d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5ea940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5ef390 con 0x55c66c20c280 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5efa60 con 0x55c66c221350 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8341f9d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5f0130 con 0x55c66c2040a0 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51512/0 (socket says 172.21.15.16:51512) 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 -- 172.21.15.16:0/1035641555 learned_addr learned my addr 172.21.15.16:0/1035641555 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8338fc4640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f83397c5640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 0x55c66c5d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 -- 172.21.15.16:0/1035641555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 msgr2=0x55c66c5ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5ea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 -- 172.21.15.16:0/1035641555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 msgr2=0x55c66c5d9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 0x55c66c5d9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 -- 172.21.15.16:0/1035641555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66c5d5d60 con 0x55c66c20c280 2024-09-21T00:45:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f83397c5640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 0x55c66c5d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.271+0000 7f8339fc6640 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f832c009ec0 tx=0x7f832c005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd5da826ea44e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f831effd640 1 -- 172.21.15.16:0/1035641555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0119b0 con 0x55c66c20c280 2024-09-21T00:45:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f831effd640 1 -- 172.21.15.16:0/1035641555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f832c01fc10 con 0x55c66c20c280 2024-09-21T00:45:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f831effd640 1 -- 172.21.15.16:0/1035641555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c033420 con 0x55c66c20c280 2024-09-21T00:45:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 -- 172.21.15.16:0/1035641555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 msgr2=0x55c66c5eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f832c009ec0 tx=0x7f832c005d10 comp rx=0 tx=0).stop 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 -- 172.21.15.16:0/1035641555 shutdown_connections 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c20c280 0x55c66c5eae80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 --2- 172.21.15.16:0/1035641555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c221350 0x55c66c5d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 -- 172.21.15.16:0/1035641555 >> 172.21.15.16:0/1035641555 conn(0x55c66c5eef80 msgr2=0x55c66c5d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 -- 172.21.15.16:0/1035641555 shutdown_connections 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.272+0000 7f8341f9d740 1 -- 172.21.15.16:0/1035641555 wait complete. 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 -- start start 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 Processor -- start 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 0x55c66c5f3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5f0ed0 con 0x55c66c221350 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5f0800 con 0x55c66c20c280 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c66c5f15a0 con 0x55c66c2040a0 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.273+0000 7f8341f9d740 10 client.0 _ll_register_callbacks cb 0x7f832c009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f83397c5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f83397c5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:51614/0 (socket says 172.21.15.16:51614) 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51516/0 (socket says 172.21.15.16:51516) 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f83397c5640 1 -- 172.21.15.16:0/2168936335 learned_addr learned my addr 172.21.15.16:0/2168936335 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8338fc4640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 0x55c66c5f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 -- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 msgr2=0x55c66c5f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 -- 172.21.15.16:0/2168936335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 msgr2=0x55c66c5f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 0x55c66c5f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 -- 172.21.15.16:0/2168936335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66c5f8a30 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f83397c5640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8338fc4640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 0x55c66c5f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8339fc6640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f832c018040 tx=0x7f832c020dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b34ed3074f426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f831cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0119b0 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f832c003970 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.274+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f832c01fc10 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f832c020830 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 10 client.15198 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c66c65c6e0 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f832c01fc10 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f832c00f040 con 0x55c66c221350 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 10 client.15198 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 10 client.15198 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 20 client.15198 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c22cf60 0x55c66c65fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 4 client.15198 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "status"}) -- 0x55c66c548610 con 0x55c66c22cf60 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.275+0000 7f83397c5640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c22cf60 0x55c66c65fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f83397c5640 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c22cf60 0x55c66c65fb50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce556361d68d4477 server_cookie=dbe8d0d9342f1d6f in_seq=0 out_seq=0 2024-09-21T00:45:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f831cff9640 10 client.15198 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f831cff9640 1 -- 172.21.15.16:0/2168936335 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55c66c548610 con 0x55c66c22cf60 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f831cff9640 10 client.15198 handle_command_reply: tid=0 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 client.15198 shutdown 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 msgr2=0x55c66c5f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f832c018040 tx=0x7f832c020dd0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 shutdown_connections 2024-09-21T00:45:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55c66c22cf60 0x55c66c65fb50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c66c221350 0x55c66c5f3d70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c66c20c280 0x55c66c5f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f831cff9640 0 client.15198 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 --2- 172.21.15.16:0/2168936335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c66c2040a0 0x55c66c5f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 >> 172.21.15.16:0/2168936335 conn(0x55c66c5eef80 msgr2=0x55c66c5d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.276+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 shutdown_connections 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f8341f9d740 1 -- 172.21.15.16:0/2168936335 wait complete. 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f8341f9d740 20 client.15198 trim_cache size 0 max 16384 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-09-21T00:45:41.282 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24625, 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 73.546432027999998, 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 103.30689649 2024-09-21T00:45:41.283 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 msgr2=0x7f83200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 0x7f83200b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f832c005fd0 tx=0x7f832c009600 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 msgr2=0x7f8334075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f832400c970 tx=0x7f832400ce30 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 shutdown_connections 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83200b65a0 0x7f83200b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8334109df0 0x7f8334076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83341094a0 0x7f8334075c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 --2- 172.21.15.16:0/1644146664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8334103b60 0x7f8334075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 >> 172.21.15.16:0/1644146664 conn(0x7f833407b850 msgr2=0x7f8334107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 shutdown_connections 2024-09-21T00:45:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:41.277+0000 7f833ba29640 1 -- 172.21.15.16:0/1644146664 wait complete. 2024-09-21T00:45:41.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T00:45:42.239 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:42.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:41 smithi016 ceph-mon[30947]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:42.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:41 smithi123 ceph-mon[34853]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:42.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:41 smithi178 ceph-mon[34888]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:45:42.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.731+0000 7f2cf0360640 1 -- 172.21.15.16:0/1746777764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8109df0 msgr2=0x7f2ce8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.731+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1746777764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8109df0 0x7f2ce8110620 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009ca0 tx=0x7f2ce002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 -- 172.21.15.16:0/1746777764 shutdown_connections 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1746777764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8109df0 0x7f2ce8110620 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1746777764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1746777764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8103b60 0x7f2ce8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 -- 172.21.15.16:0/1746777764 >> 172.21.15.16:0/1746777764 conn(0x7f2ce807b850 msgr2=0x7f2ce807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 -- 172.21.15.16:0/1746777764 shutdown_connections 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 -- 172.21.15.16:0/1746777764 wait complete. 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 Processor -- start 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.732+0000 7f2cf0360640 1 -- start start 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8109df0 0x7f2ce819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8113ab0 con 0x7f2ce8103b60 2024-09-21T00:45:42.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8113930 con 0x7f2ce8109df0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8113c30 con 0x7f2ce81094a0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51534/0 (socket says 172.21.15.16:51534) 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1367319545 learned_addr learned my addr 172.21.15.16:0/1367319545 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8109df0 0x7f2ce819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1367319545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 msgr2=0x7f2ce819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1367319545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8109df0 msgr2=0x7f2ce819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8109df0 0x7f2ce819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1367319545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce81a04d0 con 0x7f2ce8103b60 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400d950 tx=0x7f2ce400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cdf7fe640 1 -- 172.21.15.16:0/1367319545 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4017070 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cdf7fe640 1 -- 172.21.15.16:0/1367319545 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce4009c30 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce81a07c0 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.733+0000 7f2cdf7fe640 1 -- 172.21.15.16:0/1367319545 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400f620 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.734+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce81a6f20 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.736+0000 7f2cf68d4740 1 Processor -- start 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.736+0000 7f2cf68d4740 1 -- start start 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cdf7fe640 1 -- 172.21.15.16:0/1367319545 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2ce4010460 con 0x7f2ce8103b60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6928f60 0x5572e6ccef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6ccf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572e6c46c10 con 0x5572e69000a0 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5572e6c36040 con 0x5572e6908280 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572e6c39e50 con 0x5572e6928f60 2024-09-21T00:45:42.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51548/0 (socket says 172.21.15.16:51548) 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1288306835 learned_addr learned my addr 172.21.15.16:0/1288306835 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6928f60 0x5572e6ccef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6ccf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1288306835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6928f60 msgr2=0x5572e6ccef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6928f60 0x5572e6ccef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1288306835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 msgr2=0x5572e6ccf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6ccf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1288306835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e6994540 con 0x5572e69000a0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.737+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40e4a20 tx=0x7f2ce40ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf5dac9b8096c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cdcd9a640 1 -- 172.21.15.16:0/1288306835 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40fa070 con 0x5572e69000a0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cdf7fe640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 0x7f2cd40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cdcd9a640 1 -- 172.21.15.16:0/1288306835 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce40e79f0 con 0x5572e69000a0 2024-09-21T00:45:42.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cdcd9a640 1 -- 172.21.15.16:0/1288306835 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40f5940 con 0x5572e69000a0 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 0x7f2cd40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.738+0000 7f2cdf7fe640 1 -- 172.21.15.16:0/1367319545 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f2ce40e7040 con 0x7f2ce8103b60 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1288306835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 msgr2=0x5572e6ccf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40e4a20 tx=0x7f2ce40ef910 comp rx=0 tx=0).stop 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 0x7f2cd40b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0006010 tx=0x7f2ce00093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1288306835 shutdown_connections 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6ccf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ccf440 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1288306835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6928f60 0x5572e6ccef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1288306835 >> 172.21.15.16:0/1288306835 conn(0x5572e691d350 msgr2=0x5572e6cccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1288306835 shutdown_connections 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1288306835 wait complete. 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 -- start start 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.739+0000 7f2cf68d4740 1 Processor -- start 2024-09-21T00:45:42.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e69000a0 0x5572e6cdaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6cdafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572e6a975f0 con 0x5572e6928f60 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5572e6bd1010 con 0x5572e6908280 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572e6cdd6e0 con 0x5572e69000a0 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cf68d4740 10 client.0 _ll_register_callbacks cb 0x5572e6c30340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51550/0 (socket says 172.21.15.16:51550) 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 -- 172.21.15.16:0/484390494 learned_addr learned my addr 172.21.15.16:0/484390494 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e69000a0 0x5572e6cdaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6cdafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 -- 172.21.15.16:0/484390494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e69000a0 msgr2=0x5572e6cdaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e69000a0 0x5572e6cdaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 -- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 msgr2=0x5572e6cdafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6cdafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 -- 172.21.15.16:0/484390494 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e6bfea00 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00316d0 tx=0x7f2ce00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7866e381742acbae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.740+0000 7f2cd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce004f070 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f2ce0004240 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce40e79f0 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ce005b050 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 10 client.15210 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572e6ce9680 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce40e79f0 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2ce0044040 con 0x5572e6928f60 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 10 client.15210 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:42.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 10 client.15210 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 20 client.15210 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68e78e0 0x5572e6ced170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 4 client.15210 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.741+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572e6c48b60 con 0x5572e68e78e0 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.742+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68e78e0 0x5572e6ced170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.742+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68e78e0 0x5572e6ced170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ddb6e144ac29f4b server_cookie=5124d6b74e875160 in_seq=0 out_seq=0 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.742+0000 7f2cd1ffb640 10 client.15210 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/484390494 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572e6c48b60 con 0x5572e68e78e0 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cd1ffb640 10 client.15210 handle_command_reply: tid=0 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 client.15210 shutdown 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 msgr2=0x5572e6ce6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00316d0 tx=0x7f2ce00095c0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 shutdown_connections 2024-09-21T00:45:42.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68e78e0 0x5572e6ced170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e6928f60 0x5572e6ce6a00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6908280 0x5572e6cdafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cd1ffb640 0 client.15210 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/484390494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e69000a0 0x5572e6cdaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.743+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 >> 172.21.15.16:0/484390494 conn(0x5572e691d350 msgr2=0x5572e6cd2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.744+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 shutdown_connections 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.744+0000 7f2cf68d4740 1 -- 172.21.15.16:0/484390494 wait complete. 2024-09-21T00:45:42.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.744+0000 7f2cf68d4740 20 client.15210 trim_cache size 0 max 16384 2024-09-21T00:45:42.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.762+0000 7f2cf68d4740 1 Processor -- start 2024-09-21T00:45:42.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.762+0000 7f2cf68d4740 1 -- start start 2024-09-21T00:45:42.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6ce6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6cd59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572e6ceb4b0 con 0x5572e69000a0 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5572e6cebb80 con 0x5572e6928f60 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572e6cec250 con 0x5572e6908280 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51558/0 (socket says 172.21.15.16:51558) 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1521721514 learned_addr learned my addr 172.21.15.16:0/1521721514 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6ce6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6cd59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1521721514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 msgr2=0x5572e6ce6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6ce6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1521721514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 msgr2=0x5572e6cd59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6cd59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 -- 172.21.15.16:0/1521721514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e6cd1d60 con 0x5572e69000a0 2024-09-21T00:45:42.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40f5470 tx=0x7f2ce40f54a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b2a0724fbe5406 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cd3fff640 1 -- 172.21.15.16:0/1521721514 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4020070 con 0x5572e69000a0 2024-09-21T00:45:42.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cd3fff640 1 -- 172.21.15.16:0/1521721514 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce40ea9f0 con 0x5572e69000a0 2024-09-21T00:45:42.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.763+0000 7f2cd3fff640 1 -- 172.21.15.16:0/1521721514 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40d0040 con 0x5572e69000a0 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1521721514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 msgr2=0x5572e6ce6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40f5470 tx=0x7f2ce40f54a0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1521721514 shutdown_connections 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6cd59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6ce6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/1521721514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6ce6970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1521721514 >> 172.21.15.16:0/1521721514 conn(0x5572e691d350 msgr2=0x5572e6cdaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1521721514 shutdown_connections 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.764+0000 7f2cf68d4740 1 -- 172.21.15.16:0/1521721514 wait complete. 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 -- start start 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 Processor -- start 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6cf5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6ceeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572e6cecff0 con 0x5572e69000a0 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5572e6cec920 con 0x5572e6928f60 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572e6ced6c0 con 0x5572e6908280 2024-09-21T00:45:42.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cf68d4740 10 client.0 _ll_register_callbacks cb 0x7f2ce0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cee0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51572/0 (socket says 172.21.15.16:51572) 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2cee0fc640 1 -- 172.21.15.16:0/2933190207 learned_addr learned my addr 172.21.15.16:0/2933190207 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.765+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6cf5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee8fd640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6ceeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 -- 172.21.15.16:0/2933190207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 msgr2=0x5572e6cf5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6cf5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 -- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 msgr2=0x5572e6ceeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6ceeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 -- 172.21.15.16:0/2933190207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e6cef650 con 0x5572e69000a0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cee0fc640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40a9730 tx=0x7f2ce40ea790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0710d64da8acd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4020030 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f2ce40ea380 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce40ea9f0 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ce40d0050 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cf68d4740 10 client.15216 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.766+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572e6cf5060 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce40ea9f0 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2ce40b66f0 con 0x5572e69000a0 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 10 client.15216 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 10 client.15216 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 20 client.15216 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68bcc90 0x5572e6d5b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 4 client.15216 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "status"}) -- 0x5572e6c44610 con 0x5572e68bcc90 2024-09-21T00:45:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68bcc90 0x5572e6d5b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2ced8fb640 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68bcc90 0x5572e6d5b500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=418966adc143c079 server_cookie=946936823d50ed00 in_seq=0 out_seq=0 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.767+0000 7f2cd1ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cd1ffb640 1 -- 172.21.15.16:0/2933190207 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5572e6c44610 con 0x5572e68bcc90 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cd1ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 client.15216 shutdown 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 msgr2=0x5572e6cf5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40a9730 tx=0x7f2ce40ea790 comp rx=0 tx=0).stop 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 shutdown_connections 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x5572e68bcc90 0x5572e6d5b500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5572e6928f60 0x5572e6ceeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572e6908280 0x5572e6cf5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 --2- 172.21.15.16:0/2933190207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572e69000a0 0x5572e6cf5860 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 >> 172.21.15.16:0/2933190207 conn(0x5572e691d350 msgr2=0x5572e6cd59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cd1ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 shutdown_connections 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 1 -- 172.21.15.16:0/2933190207 wait complete. 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.768+0000 7f2cf68d4740 20 client.15216 trim_cache size 0 max 16384 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24644, 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:45:42.774 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 76.044158053999993, 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 107.37207324400001 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:45:42.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 msgr2=0x7f2cd40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 0x7f2cd40b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0006010 tx=0x7f2ce00093f0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 msgr2=0x7f2ce819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400d950 tx=0x7f2ce400de10 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 shutdown_connections 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd40b6620 0x7f2cd40b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce8109df0 0x7f2ce819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ce81094a0 0x7f2ce819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 --2- 172.21.15.16:0/1367319545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce8103b60 0x7f2ce819a560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 >> 172.21.15.16:0/1367319545 conn(0x7f2ce807b850 msgr2=0x7f2ce81075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 shutdown_connections 2024-09-21T00:45:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:42.769+0000 7f2cf0360640 1 -- 172.21.15.16:0/1367319545 wait complete. 2024-09-21T00:45:43.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:45:43.751 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:44.191 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:43 smithi016 ceph-mon[30947]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:44.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:43 smithi123 ceph-mon[34853]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:44.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:43 smithi178 ceph-mon[34888]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.283+0000 7fae2312e640 1 -- 172.21.15.16:0/2889471729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 msgr2=0x7fae1c1055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.283+0000 7fae2312e640 1 --2- 172.21.15.16:0/2889471729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c1055d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009900 tx=0x7fae0c02a410 comp rx=0 tx=0).stop 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 -- 172.21.15.16:0/2889471729 shutdown_connections 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 --2- 172.21.15.16:0/2889471729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c105b10 0x7fae1c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 --2- 172.21.15.16:0/2889471729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c1055d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 --2- 172.21.15.16:0/2889471729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c1031b0 0x7fae1c1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 -- 172.21.15.16:0/2889471729 >> 172.21.15.16:0/2889471729 conn(0x7fae1c079e40 msgr2=0x7fae1c07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 -- 172.21.15.16:0/2889471729 shutdown_connections 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 -- 172.21.15.16:0/2889471729 wait complete. 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 Processor -- start 2024-09-21T00:45:44.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.284+0000 7fae2312e640 1 -- start start 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c1031b0 0x7fae1c10ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 0x7fae1c110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c113af0 con 0x7fae1c1051c0 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c113970 con 0x7fae1c105b10 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c113c70 con 0x7fae1c1031b0 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54288/0 (socket says 172.21.15.16:54288) 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 -- 172.21.15.16:0/495752624 learned_addr learned my addr 172.21.15.16:0/495752624 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae20eca640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c1031b0 0x7fae1c10ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae216cb640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 0x7fae1c110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 -- 172.21.15.16:0/495752624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c1031b0 msgr2=0x7fae1c10ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c1031b0 0x7fae1c10ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 -- 172.21.15.16:0/495752624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 msgr2=0x7fae1c110980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 0x7fae1c110980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 -- 172.21.15.16:0/495752624 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c1a8740 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae216cb640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 0x7fae1c110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae1bfff640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fae0c005940 tx=0x7fae0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae19ffb640 1 -- 172.21.15.16:0/495752624 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c03f030 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae19ffb640 1 -- 172.21.15.16:0/495752624 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae0c003cb0 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.285+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c1a89d0 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.286+0000 7fae19ffb640 1 -- 172.21.15.16:0/495752624 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c035070 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.286+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c1a8f00 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.288+0000 7fae296a2740 1 Processor -- start 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.288+0000 7fae296a2740 1 -- start start 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.288+0000 7fae19ffb640 1 -- 172.21.15.16:0/495752624 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fae0c042030 con 0x7fae1c1051c0 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea79f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea7a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84e9f1c10 con 0x55b84e6ab0a0 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b84e9e1040 con 0x55b84e6b3280 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae296a2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b84e9e4e50 con 0x55b84e6d3f60 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54304/0 (socket says 172.21.15.16:54304) 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 -- 172.21.15.16:0/2397610187 learned_addr learned my addr 172.21.15.16:0/2397610187 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae216cb640 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea79f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae1bfff640 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea7a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 -- 172.21.15.16:0/2397610187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 msgr2=0x55b84ea79f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea79f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 -- 172.21.15.16:0/2397610187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 msgr2=0x55b84ea7a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea7a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 -- 172.21.15.16:0/2397610187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e73f540 con 0x55b84e6ab0a0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae19ffb640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 0x7fae080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.289+0000 7fae20eca640 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae0400bc70 tx=0x7fae040107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330ed8e6db499f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.290+0000 7fae216cb640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 0x7fae080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.290+0000 7fae12ffd640 1 -- 172.21.15.16:0/2397610187 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04004020 con 0x55b84e6ab0a0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.290+0000 7fae19ffb640 1 -- 172.21.15.16:0/495752624 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fae0c107830 con 0x7fae1c1051c0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.290+0000 7fae12ffd640 1 -- 172.21.15.16:0/2397610187 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae040041c0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.290+0000 7fae12ffd640 1 -- 172.21.15.16:0/2397610187 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae040116a0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- 172.21.15.16:0/2397610187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 msgr2=0x55b84ea7a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae216cb640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 0x7fae080b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae14005fd0 tx=0x7fae14009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae0400bc70 tx=0x7fae040107a0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- 172.21.15.16:0/2397610187 shutdown_connections 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea7a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea7a440 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 --2- 172.21.15.16:0/2397610187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- 172.21.15.16:0/2397610187 >> 172.21.15.16:0/2397610187 conn(0x55b84e6c8350 msgr2=0x55b84ea77df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- 172.21.15.16:0/2397610187 shutdown_connections 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- 172.21.15.16:0/2397610187 wait complete. 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 -- start start 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.291+0000 7fae296a2740 1 Processor -- start 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea85d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84e8425f0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b84e97c010 con 0x55b84e6b3280 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea886e0 con 0x55b84e6d3f60 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae296a2740 10 client.0 _ll_register_callbacks cb 0x55b84e9db340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54314/0 (socket says 172.21.15.16:54314) 2024-09-21T00:45:44.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 -- 172.21.15.16:0/1099831685 learned_addr learned my addr 172.21.15.16:0/1099831685 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae216cb640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae1bfff640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea85d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 -- 172.21.15.16:0/1099831685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 msgr2=0x55b84ea91a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea91a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 -- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 msgr2=0x55b84ea85d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea85d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 -- 172.21.15.16:0/1099831685 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84e9a9a00 con 0x55b84e6ab0a0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae1bfff640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea85d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae216cb640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fae20eca640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae04011010 tx=0x7fae04004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed00a9dbd9384d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.292+0000 7fadfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0402a060 con 0x55b84e6ab0a0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae040041c0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fae04005240 con 0x55b84e6ab0a0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fae04005440 con 0x55b84e6ab0a0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 10 client.15228 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b84ea94600 con 0x55b84e6ab0a0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae040041c0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fae040049d0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 10 client.15228 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 20 client.15228 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e6928e0 0x55b84ea97c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 4 client.15228 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.293+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84e9f3b60 con 0x55b84e6928e0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.294+0000 7fae1bfff640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e6928e0 0x55b84ea97c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.294+0000 7fadfbfff640 10 client.15228 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:45:44.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.294+0000 7fae1bfff640 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e6928e0 0x55b84ea97c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c5392d0f47f5ab server_cookie=9a700de97b84ebf4 in_seq=0 out_seq=0 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fadfbfff640 1 -- 172.21.15.16:0/1099831685 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b84e9f3b60 con 0x55b84e6928e0 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fadfbfff640 10 client.15228 handle_command_reply: tid=0 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 client.15228 shutdown 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 msgr2=0x55b84ea85790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae04011010 tx=0x7fae04004050 comp rx=0 tx=0).stop 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 shutdown_connections 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e6928e0 0x55b84ea97c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea85d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 --2- 172.21.15.16:0/1099831685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea85790 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fadfbfff640 0 client.15228 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 >> 172.21.15.16:0/1099831685 conn(0x55b84e6c8350 msgr2=0x55b84ea7d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 shutdown_connections 2024-09-21T00:45:44.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.295+0000 7fae296a2740 1 -- 172.21.15.16:0/1099831685 wait complete. 2024-09-21T00:45:44.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.296+0000 7fae296a2740 20 client.15228 trim_cache size 0 max 16384 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 Processor -- start 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 -- start start 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 0x55b84ea80020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea72ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea95fb0 con 0x55b84e6d3f60 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea96680 con 0x55b84e6b3280 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae296a2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea96d50 con 0x55b84e6ab0a0 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54328/0 (socket says 172.21.15.16:54328) 2024-09-21T00:45:44.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 -- 172.21.15.16:0/2991600949 learned_addr learned my addr 172.21.15.16:0/2991600949 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae20eca640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 0x55b84ea80020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae1bfff640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea72ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 -- 172.21.15.16:0/2991600949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 msgr2=0x55b84ea80020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 0x55b84ea80020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 -- 172.21.15.16:0/2991600949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 msgr2=0x55b84ea72ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea72ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae216cb640 1 -- 172.21.15.16:0/2991600949 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84ea86730 con 0x55b84e6d3f60 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae20eca640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 0x55b84ea80020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.314+0000 7fae1bfff640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea72ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.315+0000 7fae216cb640 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae140105c0 tx=0x7fae14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa018f6310d6ee32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.315+0000 7fae127fc640 1 -- 172.21.15.16:0/2991600949 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14028440 con 0x55b84e6d3f60 2024-09-21T00:45:44.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.315+0000 7fae127fc640 1 -- 172.21.15.16:0/2991600949 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1401e8c0 con 0x55b84e6d3f60 2024-09-21T00:45:44.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.315+0000 7fae127fc640 1 -- 172.21.15.16:0/2991600949 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae140278e0 con 0x55b84e6d3f60 2024-09-21T00:45:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- 172.21.15.16:0/2991600949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 msgr2=0x55b84ea919d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae140105c0 tx=0x7fae14015000 comp rx=0 tx=0).stop 2024-09-21T00:45:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- 172.21.15.16:0/2991600949 shutdown_connections 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6d3f60 0x55b84ea919d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea72ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 --2- 172.21.15.16:0/2991600949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6ab0a0 0x55b84ea80020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- 172.21.15.16:0/2991600949 >> 172.21.15.16:0/2991600949 conn(0x55b84e6c8350 msgr2=0x55b84ea80940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- 172.21.15.16:0/2991600949 shutdown_connections 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- 172.21.15.16:0/2991600949 wait complete. 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 -- start start 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.316+0000 7fae296a2740 1 Processor -- start 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea9a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea9f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea97af0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea97420 con 0x55b84e6b3280 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b84ea981c0 con 0x55b84e6d3f60 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae296a2740 10 client.0 _ll_register_callbacks cb 0x7fae0c10d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54336/0 (socket says 172.21.15.16:54336) 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 -- 172.21.15.16:0/3085722530 learned_addr learned my addr 172.21.15.16:0/3085722530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae216cb640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea9f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae1bfff640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea9a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 -- 172.21.15.16:0/3085722530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 msgr2=0x55b84ea9f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea9f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 -- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 msgr2=0x55b84ea9a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea9a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 -- 172.21.15.16:0/3085722530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84ea9afd0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fae20eca640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae04004fd0 tx=0x7fae0400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a99b51d5824817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.317+0000 7fadfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0403d060 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fae04004640 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1401e8c0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fae0400bac0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 10 client.15234 fetch_fsmap learned FSMap version 27 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b84eb03560 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1401e8c0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fae040035f0 con 0x55b84e6ab0a0 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 10 client.15234 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 20 client.15234 populate_metadata read hostname 'smithi016' 2024-09-21T00:45:44.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e667c90 0x55b84eb06d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 4 client.15234 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.318+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "status"}) -- 0x55b84e9ef610 con 0x55b84e667c90 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae1bfff640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e667c90 0x55b84eb06d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae1bfff640 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e667c90 0x55b84eb06d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5e0a00f24f1eb1 server_cookie=7b73b1146310744d in_seq=0 out_seq=0 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fadfbfff640 10 client.15234 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fadfbfff640 1 -- 172.21.15.16:0/3085722530 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b84e9ef610 con 0x55b84e667c90 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fadfbfff640 10 client.15234 handle_command_reply: tid=0 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 client.15234 shutdown 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 msgr2=0x55b84ea9a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae04004fd0 tx=0x7fae0400b390 comp rx=0 tx=0).stop 2024-09-21T00:45:44.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 shutdown_connections 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b84e667c90 0x55b84eb06d50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b84e6d3f60 0x55b84ea9f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.319+0000 7fadfbfff640 0 client.15234 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b84e6b3280 0x55b84ea9a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 1 --2- 172.21.15.16:0/3085722530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84e6ab0a0 0x55b84ea9a210 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 >> 172.21.15.16:0/3085722530 conn(0x55b84e6c8350 msgr2=0x55b84ea763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 shutdown_connections 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 1 -- 172.21.15.16:0/3085722530 wait complete. 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae296a2740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T00:45:44.327 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24677, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 85.640543312999995, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 96.868877105999999 2024-09-21T00:45:44.328 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 msgr2=0x7fae080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 0x7fae080b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae14005fd0 tx=0x7fae14009700 comp rx=0 tx=0).stop 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 msgr2=0x7fae1c110440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.320+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fae0c005940 tx=0x7fae0c0042f0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 shutdown_connections 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fae080b6620 0x7fae080b8b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1c105b10 0x7fae1c110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae1c1051c0 0x7fae1c110440 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 --2- 172.21.15.16:0/495752624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c1031b0 0x7fae1c10ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:44.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 >> 172.21.15.16:0/495752624 conn(0x7fae1c079e40 msgr2=0x7fae1c1063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:44.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 shutdown_connections 2024-09-21T00:45:44.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:44.321+0000 7fae2312e640 1 -- 172.21.15.16:0/495752624 wait complete. 2024-09-21T00:45:45.060 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T00:45:45.060 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:45:45.069 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:45:45.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T00:45:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:45.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/3203631023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 msgr2=0x7ff69c103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:45.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/3203631023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c103bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009900 tx=0x7ff68c02a480 comp rx=0 tx=0).stop 2024-09-21T00:45:45.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/3203631023 shutdown_connections 2024-09-21T00:45:45.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/3203631023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 0x7ff69c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/3203631023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 0x7ff69c104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/3203631023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c103bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/3203631023 >> 172.21.15.16:0/3203631023 conn(0x7ff69c0ff0f0 msgr2=0x7ff69c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/3203631023 shutdown_connections 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.842+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/3203631023 wait complete. 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 Processor -- start 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 -- start start 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 0x7ff69c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 0x7ff69c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f3a0 con 0x7ff69c103780 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f220 con 0x7ff69c104810 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff6a1a0e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f520 con 0x7ff69c1051b0 2024-09-21T00:45:45.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff69affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.843+0000 7ff69affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54354/0 (socket says 172.21.15.16:54354) 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 -- 172.21.15.16:0/83068215 learned_addr learned my addr 172.21.15.16:0/83068215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69a7fc640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 0x7ff69c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69b7fe640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 0x7ff69c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 -- 172.21.15.16:0/83068215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 msgr2=0x7ff69c19b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 0x7ff69c19b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 -- 172.21.15.16:0/83068215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 msgr2=0x7ff69c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 0x7ff69c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 -- 172.21.15.16:0/83068215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c19ba00 con 0x7ff69c103780 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff69affd640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006010 tx=0x7ff68c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c03f030 con 0x7ff69c103780 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff68c003cb0 con 0x7ff69c103780 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c19bc90 con 0x7ff69c103780 2024-09-21T00:45:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c035070 con 0x7ff69c103780 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.844+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a2220 con 0x7ff69c103780 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.846+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c10a960 con 0x7ff69c103780 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.847+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ff68c042030 con 0x7ff69c103780 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.848+0000 7ff6a0a0c640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 0x7ff6840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.848+0000 7ff69a7fc640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 0x7ff6840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.848+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7ff68c107ae0 con 0x7ff69c103780 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.848+0000 7ff69a7fc640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 0x7ff6840b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff69000bbe0 tx=0x7ff69000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:45.852+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff68c003e60 con 0x7ff69c103780 2024-09-21T00:45:46.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:45 smithi016 ceph-mon[30947]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:46.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.057+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff69c063800 con 0x7ff6840b65a0 2024-09-21T00:45:46.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.059+0000 7ff6a0a0c640 1 -- 172.21.15.16:0/83068215 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff69c063800 con 0x7ff6840b65a0 2024-09-21T00:45:46.059 INFO:teuthology.orchestra.run.smithi016.stdout:Backend: cephadm 2024-09-21T00:45:46.060 INFO:teuthology.orchestra.run.smithi016.stdout:Available: Yes 2024-09-21T00:45:46.060 INFO:teuthology.orchestra.run.smithi016.stdout:Paused: No 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 msgr2=0x7ff6840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 0x7ff6840b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff69000bbe0 tx=0x7ff69000b390 comp rx=0 tx=0).stop 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 msgr2=0x7ff69c199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006010 tx=0x7ff68c004340 comp rx=0 tx=0).stop 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 shutdown_connections 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff6840b65a0 0x7ff6840b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff69c1051b0 0x7ff69c19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff69c104810 0x7ff69c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:46.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 --2- 172.21.15.16:0/83068215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff69c103780 0x7ff69c199fd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:46.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 >> 172.21.15.16:0/83068215 conn(0x7ff69c0ff0f0 msgr2=0x7ff69c107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:46.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 shutdown_connections 2024-09-21T00:45:46.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:46.061+0000 7ff6a1a0e640 1 -- 172.21.15.16:0/83068215 wait complete. 2024-09-21T00:45:46.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:45 smithi123 ceph-mon[34853]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:45 smithi178 ceph-mon[34888]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:45:46.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T00:45:47.017 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- 172.21.15.16:0/2616052707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54281051a0 msgr2=0x7f542810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2616052707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54281051a0 0x7f542810bb40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5420009ca0 tx=0x7f542002a950 comp rx=0 tx=0).stop 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- 172.21.15.16:0/2616052707 shutdown_connections 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2616052707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54281051a0 0x7f542810bb40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2616052707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5428104800 0x7f5428104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2616052707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5428103770 0x7f5428103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- 172.21.15.16:0/2616052707 >> 172.21.15.16:0/2616052707 conn(0x7f54280ff0c0 msgr2=0x7f5428101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- 172.21.15.16:0/2616052707 shutdown_connections 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- 172.21.15.16:0/2616052707 wait complete. 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 Processor -- start 2024-09-21T00:45:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.518+0000 7f542fbf6640 1 -- start start 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5428104800 0x7f542819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281051a0 0x7f542819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f542810f3c0 con 0x7f5428103770 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f542810f240 con 0x7f5428104800 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f542810f540 con 0x7f54281051a0 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54362/0 (socket says 172.21.15.16:54362) 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 -- 172.21.15.16:0/2138615916 learned_addr learned my addr 172.21.15.16:0/2138615916 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542e193640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281051a0 0x7f542819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 -- 172.21.15.16:0/2138615916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281051a0 msgr2=0x7f542819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281051a0 0x7f542819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 -- 172.21.15.16:0/2138615916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5428104800 msgr2=0x7f542819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5428104800 0x7f542819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 -- 172.21.15.16:0/2138615916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542819b950 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542d992640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f541800d770 tx=0x7f541800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418017070 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54180054d0 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542819bc40 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.519+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418004c30 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.520+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281a2200 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.520+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542810a950 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.522+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5418004dd0 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.523+0000 7f5426ffd640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 0x7f54100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.523+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f54180e7330 con 0x7f5428103770 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.523+0000 7f542d191640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 0x7f54100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:47.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.524+0000 7f542d191640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 0x7f54100b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f541c00a990 tx=0x7f541c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:47.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.526+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54180adb50 con 0x7f5428103770 2024-09-21T00:45:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.729+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5428063800 con 0x7f54100b65a0 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.742+0000 7f5426ffd640 1 -- 172.21.15.16:0/2138615916 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f5428063800 con 0x7f54100b65a0 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.a smithi016 running (103s) 22s ago 102s 87.2M - 19.3.0-5120-g18432218 ddce307e1f32 edfe208f3b2c 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.b smithi123 running (100s) 35s ago 100s 94.2M - 19.3.0-5120-g18432218 ddce307e1f32 8c4352023fd7 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.c smithi178 running (115s) 35s ago 114s 86.1M - 19.3.0-5120-g18432218 ddce307e1f32 725fba4cd107 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.d smithi016 running (2m) 22s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 caacc9d84794 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.e smithi123 running (2m) 35s ago 2m 85.3M - 19.3.0-5120-g18432218 ddce307e1f32 0c9eb74bfb93 2024-09-21T00:45:47.743 INFO:teuthology.orchestra.run.smithi016.stdout:mds.f smithi178 running (118s) 35s ago 117s 86.0M - 19.3.0-5120-g18432218 ddce307e1f32 2c6b2f1f2bf2 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.g smithi016 running (106s) 22s ago 106s 84.6M - 19.3.0-5120-g18432218 ddce307e1f32 9daa60307111 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.h smithi123 running (112s) 35s ago 112s 85.4M - 19.3.0-5120-g18432218 ddce307e1f32 a02cfbcc7e31 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.i smithi178 running (110s) 35s ago 109s 88.2M - 19.3.0-5120-g18432218 ddce307e1f32 752aeae15ffe 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.j smithi016 running (2m) 22s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 fdfd6ea6d953 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.k smithi123 running (2m) 35s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 7e3b6e071f01 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mds.l smithi178 running (2m) 35s ago 2m 84.6M - 19.3.0-5120-g18432218 ddce307e1f32 34a02085604c 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi016 *:9283,8765 running (9m) 22s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 f2d84b65d8c0 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi123 *:8443,8765 running (7m) 35s ago 7m 523M - 19.3.0-5120-g18432218 ddce307e1f32 be5985bc1457 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.z smithi178 *:8443,8765 running (8m) 35s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 039a0166570a 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (9m) 22s ago 9m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 78519b760475 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi123 running (8m) 35s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 90362e7916a0 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi178 running (8m) 35s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 dd9b5a929fa8 2024-09-21T00:45:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 22s ago 7m 123M 4273M 19.3.0-5120-g18432218 ddce307e1f32 f267913b78dd 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi123 running (6m) 35s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 71ce5be3029c 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi178 running (6m) 35s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9f2b80850764 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (5m) 22s ago 5m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 95f7217250a1 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi123 running (5m) 35s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 3959561130ab 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi178 running (5m) 35s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9c27f03b40e9 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi016 running (4m) 22s ago 4m 118M 4273M 19.3.0-5120-g18432218 ddce307e1f32 493df27ca25f 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi123 running (4m) 35s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ae1684ca2d8f 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.8 smithi178 running (3m) 35s ago 3m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 c9b1d6786e0b 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.9 smithi016 running (3m) 22s ago 3m 108M 4273M 19.3.0-5120-g18432218 ddce307e1f32 3a91766e6c82 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.10 smithi123 running (2m) 35s ago 2m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ec8f4620212e 2024-09-21T00:45:47.745 INFO:teuthology.orchestra.run.smithi016.stdout:osd.11 smithi178 running (2m) 35s ago 2m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 78181cea4a48 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 msgr2=0x7f54100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 0x7f54100b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f541c00a990 tx=0x7f541c005c70 comp rx=0 tx=0).stop 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 msgr2=0x7f5428199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f541800d770 tx=0x7f541800dc30 comp rx=0 tx=0).stop 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 shutdown_connections 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54100b65a0 0x7f54100b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281051a0 0x7f542819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5428104800 0x7f542819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 --2- 172.21.15.16:0/2138615916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5428103770 0x7f5428199fb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.744+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 >> 172.21.15.16:0/2138615916 conn(0x7f54280ff0c0 msgr2=0x7f5428107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.745+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 shutdown_connections 2024-09-21T00:45:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:47.745+0000 7f542fbf6640 1 -- 172.21.15.16:0/2138615916 wait complete. 2024-09-21T00:45:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:47 smithi016 ceph-mon[30947]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:47 smithi016 ceph-mon[30947]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:47 smithi123 ceph-mon[34853]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:47 smithi123 ceph-mon[34853]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:47 smithi178 ceph-mon[34888]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:48.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:47 smithi178 ceph-mon[34888]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:45:48.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T00:45:48.898 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:49.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:49 smithi016 ceph-mon[30947]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:49 smithi123 ceph-mon[34853]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:49 smithi178 ceph-mon[34888]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3750874199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d0106920 msgr2=0x7fd6d0108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3750874199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d0106920 0x7fd6d0108d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009900 tx=0x7fd6c002a3f0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3750874199 shutdown_connections 2024-09-21T00:45:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3750874199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d01094c0 0x7fd6d010b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3750874199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d0106920 0x7fd6d0108d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3750874199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d006c660 0x7fd6d01063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3750874199 >> 172.21.15.16:0/3750874199 conn(0x7fd6d00fe000 msgr2=0x7fd6d01004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3750874199 shutdown_connections 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.404+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3750874199 wait complete. 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 Processor -- start 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 -- start start 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d0106920 0x7fd6d019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d01094c0 0x7fd6d019b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f430 con 0x7fd6d006c660 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f2b0 con 0x7fd6d0106920 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d7fe2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d010f5b0 con 0x7fd6d01094c0 2024-09-21T00:45:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d5d7e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d5d7e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54382/0 (socket says 172.21.15.16:54382) 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d5d7e640 1 -- 172.21.15.16:0/3347383745 learned_addr learned my addr 172.21.15.16:0/3347383745 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.405+0000 7fd6d557d640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d0106920 0x7fd6d019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d657f640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d01094c0 0x7fd6d019b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 -- 172.21.15.16:0/3347383745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d01094c0 msgr2=0x7fd6d019b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d01094c0 0x7fd6d019b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 -- 172.21.15.16:0/3347383745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d0106920 msgr2=0x7fd6d019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d0106920 0x7fd6d019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 -- 172.21.15.16:0/3347383745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d019ba00 con 0x7fd6d006c660 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d5d7e640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c920 tx=0x7fd6cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc007c70 con 0x7fd6d006c660 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6cc007e10 con 0x7fd6d006c660 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d019bcf0 con 0x7fd6d006c660 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc018820 con 0x7fd6d006c660 2024-09-21T00:45:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.406+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d01a2480 con 0x7fd6d006c660 2024-09-21T00:45:49.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.407+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d00ffb20 con 0x7fd6d006c660 2024-09-21T00:45:49.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.409+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd6cc00f450 con 0x7fd6d006c660 2024-09-21T00:45:49.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.410+0000 7fd6c6ffd640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 0x7fd6bc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:49.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.410+0000 7fd6d557d640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 0x7fd6bc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:49.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.410+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd6cc0e75d0 con 0x7fd6d006c660 2024-09-21T00:45:49.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.411+0000 7fd6d557d640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 0x7fd6bc0b8aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000c00 tx=0x7fd6c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:49.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.413+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6cc014030 con 0x7fd6d006c660 2024-09-21T00:45:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.611+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd6d0063800 con 0x7fd6bc0b6590 2024-09-21T00:45:49.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.616+0000 7fd6c6ffd640 1 -- 172.21.15.16:0/3347383745 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd6d0063800 con 0x7fd6bc0b6590 2024-09-21T00:45:49.618 INFO:teuthology.orchestra.run.smithi016.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T00:45:49.618 INFO:teuthology.orchestra.run.smithi016.stdout:mds.all 12/12 37s ago 2m smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-09-21T00:45:49.618 INFO:teuthology.orchestra.run.smithi016.stdout:mgr 3/3 37s ago 8m smithi016=x;smithi123=y;smithi178=z;count:3 2024-09-21T00:45:49.618 INFO:teuthology.orchestra.run.smithi016.stdout:mon 3/3 37s ago 8m smithi016:172.21.15.16=a;smithi123:172.21.15.123=b;smithi178:172.21.15.178=c;count:3 2024-09-21T00:45:49.618 INFO:teuthology.orchestra.run.smithi016.stdout:osd 12 37s ago - 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.618+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 msgr2=0x7fd6bc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 0x7fd6bc0b8aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000c00 tx=0x7fd6c0031400 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 msgr2=0x7fd6d019a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c920 tx=0x7fd6cc00cde0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 shutdown_connections 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd6bc0b6590 0x7fd6bc0b8aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d01094c0 0x7fd6d019b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d0106920 0x7fd6d019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 --2- 172.21.15.16:0/3347383745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d006c660 0x7fd6d019a060 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 >> 172.21.15.16:0/3347383745 conn(0x7fd6d00fe000 msgr2=0x7fd6d0104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 shutdown_connections 2024-09-21T00:45:49.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:49.619+0000 7fd6d7fe2640 1 -- 172.21.15.16:0/3347383745 wait complete. 2024-09-21T00:45:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:50 smithi016 ceph-mon[30947]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:45:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:50 smithi016 ceph-mon[30947]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:45:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:50 smithi123 ceph-mon[34853]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:45:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:50 smithi123 ceph-mon[34853]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:45:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:50 smithi178 ceph-mon[34888]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:45:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:50 smithi178 ceph-mon[34888]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:45:50.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T00:45:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:51.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:51 smithi016 ceph-mon[30947]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 -- 172.21.15.16:0/1847410846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83901069f0 msgr2=0x7f8390108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 --2- 172.21.15.16:0/1847410846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83901069f0 0x7f8390108e10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8384009900 tx=0x7f838402a410 comp rx=0 tx=0).stop 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 -- 172.21.15.16:0/1847410846 shutdown_connections 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 --2- 172.21.15.16:0/1847410846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8390109530 0x7f839010ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 --2- 172.21.15.16:0/1847410846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83901069f0 0x7f8390108e10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 --2- 172.21.15.16:0/1847410846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f839006c2c0 0x7f83901064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 -- 172.21.15.16:0/1847410846 >> 172.21.15.16:0/1847410846 conn(0x7f83900fe050 msgr2=0x7f8390100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 -- 172.21.15.16:0/1847410846 shutdown_connections 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.154+0000 7f839869b640 1 -- 172.21.15.16:0/1847410846 wait complete. 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 Processor -- start 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 -- start start 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 0x7f8390199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 0x7f839019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f839010f390 con 0x7f8390109530 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f839010f210 con 0x7f839006c2c0 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f839869b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f839010f510 con 0x7f83901069f0 2024-09-21T00:45:51.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54396/0 (socket says 172.21.15.16:54396) 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 -- 172.21.15.16:0/1638151193 learned_addr learned my addr 172.21.15.16:0/1638151193 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396437640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 0x7f8390199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8395c36640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 0x7f839019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 -- 172.21.15.16:0/1638151193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 msgr2=0x7f839019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 0x7f839019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 -- 172.21.15.16:0/1638151193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 msgr2=0x7f8390199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 0x7f8390199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396c38640 1 -- 172.21.15.16:0/1638151193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839019ba10 con 0x7f8390109530 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8395c36640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 0x7f839019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.155+0000 7f8396437640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 0x7f8390199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:51.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f8396c38640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f838800d750 tx=0x7f838800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388017070 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83880054d0 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388004c60 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839019bd00 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.156+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83901a2400 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.157+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8390106e00 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.158+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8388009bd0 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.159+0000 7f838f7fe640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 0x7f83780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.159+0000 7f8396437640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 0x7f83780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.159+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f83880e70e0 con 0x7f8390109530 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.160+0000 7f8396437640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 0x7f83780b8aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f8380009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:51.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.162+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83880ada80 con 0x7f8390109530 2024-09-21T00:45:51.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:51 smithi123 ceph-mon[34853]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:51.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:51 smithi178 ceph-mon[34888]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.355+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8390063800 con 0x7f83780b6590 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.357+0000 7f838f7fe640 1 -- 172.21.15.16:0/1638151193 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8390063800 con 0x7f83780b6590 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:HOST ADDR LABELS STATUS 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 172.21.15.16 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:smithi123 172.21.15.123 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:smithi178 172.21.15.178 2024-09-21T00:45:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:3 hosts in cluster 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 msgr2=0x7f83780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 0x7f83780b8aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f8380009520 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 msgr2=0x7f839019b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f838800d750 tx=0x7f838800dc10 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 shutdown_connections 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83780b6590 0x7f83780b8aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8390109530 0x7f839019b1f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83901069f0 0x7f839019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.359+0000 7f839869b640 1 --2- 172.21.15.16:0/1638151193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f839006c2c0 0x7f8390199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:51.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.360+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 >> 172.21.15.16:0/1638151193 conn(0x7f83900fe050 msgr2=0x7f8390104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:51.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.360+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 shutdown_connections 2024-09-21T00:45:51.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:51.360+0000 7f839869b640 1 -- 172.21.15.16:0/1638151193 wait complete. 2024-09-21T00:45:52.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T00:45:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:52 smithi123 ceph-mon[34853]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T00:45:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:52 smithi178 ceph-mon[34888]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T00:45:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:52.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:52 smithi016 ceph-mon[30947]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 -- 172.21.15.16:0/1687685952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 msgr2=0x7fc3d010b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/1687685952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d010b100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009900 tx=0x7fc3c002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 -- 172.21.15.16:0/1687685952 shutdown_connections 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/1687685952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 0x7fc3d010dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/1687685952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d010b100 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.968+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/1687685952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 0x7fc3d01087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.969+0000 7fc3d7f59640 1 -- 172.21.15.16:0/1687685952 >> 172.21.15.16:0/1687685952 conn(0x7fc3d00fdfe0 msgr2=0x7fc3d0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.969+0000 7fc3d7f59640 1 -- 172.21.15.16:0/1687685952 shutdown_connections 2024-09-21T00:45:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.969+0000 7fc3d7f59640 1 -- 172.21.15.16:0/1687685952 wait complete. 2024-09-21T00:45:52.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.969+0000 7fc3d7f59640 1 Processor -- start 2024-09-21T00:45:52.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.969+0000 7fc3d7f59640 1 -- start start 2024-09-21T00:45:52.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 0x7fc3d019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:52.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:52.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 0x7fc3d019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111580 con 0x7fc3d0108ce0 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111400 con 0x7fc3d006c490 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d7f59640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111700 con 0x7fc3d010b690 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54410/0 (socket says 172.21.15.16:54410) 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 -- 172.21.15.16:0/3655279582 learned_addr learned my addr 172.21.15.16:0/3655279582 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d5cf5640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 0x7fc3d019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d64f6640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 0x7fc3d019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 -- 172.21.15.16:0/3655279582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 msgr2=0x7fc3d019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 0x7fc3d019d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 -- 172.21.15.16:0/3655279582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 msgr2=0x7fc3d019c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:52.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 0x7fc3d019c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 -- 172.21.15.16:0/3655279582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d019dbd0 con 0x7fc3d0108ce0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.970+0000 7fc3d54f4640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006010 tx=0x7fc3c0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.971+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c003f030 con 0x7fc3d0108ce0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.971+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c0003cb0 con 0x7fc3d0108ce0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.971+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d019de60 con 0x7fc3d0108ce0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.971+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0035070 con 0x7fc3d0108ce0 2024-09-21T00:45:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.971+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a43f0 con 0x7fc3d0108ce0 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.972+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d00ffb00 con 0x7fc3d0108ce0 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.973+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc3c0042030 con 0x7fc3d0108ce0 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.974+0000 7fc3c6ffd640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 0x7fc3bc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.974+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc3c0107ee0 con 0x7fc3d0108ce0 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.974+0000 7fc3d5cf5640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 0x7fc3bc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:52.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.975+0000 7fc3d5cf5640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 0x7fc3bc0b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00bbe0 tx=0x7fc3cc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:52.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:52.977+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3c0003e60 con 0x7fc3d0108ce0 2024-09-21T00:45:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.174+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc3d0063800 con 0x7fc3bc0b6510 2024-09-21T00:45:53.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.176+0000 7fc3c6ffd640 1 -- 172.21.15.16:0/3655279582 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc3d0063800 con 0x7fc3bc0b6510 2024-09-21T00:45:53.177 INFO:teuthology.orchestra.run.smithi016.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T00:45:53.177 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002C480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T00:45:53.177 INFO:teuthology.orchestra.run.smithi016.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:45:53.177 INFO:teuthology.orchestra.run.smithi016.stdout:smithi178 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130029480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 msgr2=0x7fc3bc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 0x7fc3bc0b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00bbe0 tx=0x7fc3cc00b390 comp rx=0 tx=0).stop 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 msgr2=0x7fc3d019c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006010 tx=0x7fc3c0004340 comp rx=0 tx=0).stop 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 shutdown_connections 2024-09-21T00:45:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc3bc0b6510 0x7fc3bc0b8a20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3d010b690 0x7fc3d019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108ce0 0x7fc3d019c810 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 --2- 172.21.15.16:0/3655279582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d006c490 0x7fc3d019c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 >> 172.21.15.16:0/3655279582 conn(0x7fc3d00fdfe0 msgr2=0x7fc3d0109bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 shutdown_connections 2024-09-21T00:45:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:53.178+0000 7fc3d7f59640 1 -- 172.21.15.16:0/3655279582 wait complete. 2024-09-21T00:45:53.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:53 smithi123 ceph-mon[34853]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:53.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:53 smithi178 ceph-mon[34888]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:53.500 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:53 smithi016 ceph-mon[30947]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:53.916 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:45:53.925 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:45:53.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T00:45:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:54 smithi016 ceph-mon[30947]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:45:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:54 smithi123 ceph-mon[34853]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:45:54.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:54 smithi178 ceph-mon[34888]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:45:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 -- 172.21.15.16:0/1723170570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 msgr2=0x7fbff010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 --2- 172.21.15.16:0/1723170570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff010bb40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009ca0 tx=0x7fbfe802a950 comp rx=0 tx=0).stop 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 -- 172.21.15.16:0/1723170570 shutdown_connections 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 --2- 172.21.15.16:0/1723170570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff010bb40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 --2- 172.21.15.16:0/1723170570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0104800 0x7fbff0104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 --2- 172.21.15.16:0/1723170570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0103770 0x7fbff0103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 -- 172.21.15.16:0/1723170570 >> 172.21.15.16:0/1723170570 conn(0x7fbff00ff0c0 msgr2=0x7fbff0101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 -- 172.21.15.16:0/1723170570 shutdown_connections 2024-09-21T00:45:54.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.648+0000 7fbff497c640 1 -- 172.21.15.16:0/1723170570 wait complete. 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 Processor -- start 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 -- start start 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0103770 0x7fbff0076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0104800 0x7fbff0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010f490 con 0x7fbff01051a0 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010f310 con 0x7fbff0103770 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbff497c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010f610 con 0x7fbff0104800 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbfeed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbfeed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38478/0 (socket says 172.21.15.16:38478) 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbfee59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0103770 0x7fbff0076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:54.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.649+0000 7fbfeed9d640 1 -- 172.21.15.16:0/1020125800 learned_addr learned my addr 172.21.15.16:0/1020125800 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfe5d9b640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0104800 0x7fbff0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 -- 172.21.15.16:0/1020125800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0104800 msgr2=0x7fbff0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0104800 0x7fbff0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 -- 172.21.15.16:0/1020125800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0103770 msgr2=0x7fbff0076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0103770 0x7fbff0076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 -- 172.21.15.16:0/1020125800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff0076350 con 0x7fbff01051a0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfeed9d640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006010 tx=0x7fbfe8031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8034040 con 0x7fbff01051a0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe8004040 con 0x7fbff01051a0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80456e0 con 0x7fbff01051a0 2024-09-21T00:45:54.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff01a4120 con 0x7fbff01051a0 2024-09-21T00:45:54.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.650+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff01a4540 con 0x7fbff01051a0 2024-09-21T00:45:54.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.651+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff010a950 con 0x7fbff01051a0 2024-09-21T00:45:54.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.653+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbfe8037020 con 0x7fbff01051a0 2024-09-21T00:45:54.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.654+0000 7fbfe7fff640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 0x7fbfdc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:54.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.654+0000 7fbfee59c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 0x7fbfdc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:54.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.654+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbfe8108590 con 0x7fbff01051a0 2024-09-21T00:45:54.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.654+0000 7fbfee59c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 0x7fbfdc0b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009990 tx=0x7fbfe0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:54.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.657+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbfe8083710 con 0x7fbff01051a0 2024-09-21T00:45:54.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.885+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbff002e640 con 0x7fbff01051a0 2024-09-21T00:45:54.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.886+0000 7fbfe7fff640 1 -- 172.21.15.16:0/1020125800 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3132 (secure 0 0 0) 0x7fbfe80098b0 con 0x7fbff01051a0 2024-09-21T00:45:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:e27 2024-09-21T00:45:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-09-21T00:44:30:753491+0000 2024-09-21T00:45:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:45:54.887 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 27 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-09-21T00:44:18.388808+0000 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-09-21T00:44:30.753465+0000 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 300 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-09-21T00:45:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 0 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 5 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1,2,3,4 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=24677,1=24644,2=24625,3=24620,4=24613} 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-09-21T00:45:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 0 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 24677 members: 24644,24677,24625,24620,24613 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b{0:24677} state up:active seq 4 addr [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f{0:24604} state up:standby-replay seq 1 addr [v2:172.21.15.178:6834/4194574330,v1:172.21.15.178:6835/4194574330] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.h{1:24644} state up:active seq 9 addr [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.k{1:24587} state up:standby-replay seq 1 addr [v2:172.21.15.123:6832/2611682237,v1:172.21.15.123:6833/2611682237] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.i{2:24625} state up:active seq 9 addr [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.l{2:24562} state up:standby-replay seq 1 addr [v2:172.21.15.178:6832/2278158780,v1:172.21.15.178:6833/2278158780] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e{3:24620} state up:active seq 12 addr [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a{3:14790} state up:standby-replay seq 1 addr [v2:172.21.15.16:6840/1186818130,v1:172.21.15.16:6841/1186818130] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c{4:24613} state up:active seq 11 addr [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.890 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.g{4:14778} state up:standby-replay seq 1 addr [v2:172.21.15.16:6838/3052513368,v1:172.21.15.16:6839/3052513368] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.j{-1:14709} state up:standby seq 1 addr [v2:172.21.15.16:6834/4060683495,v1:172.21.15.16:6835/4060683495] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d{-1:14721} state up:standby seq 1 addr [v2:172.21.15.16:6836/220014269,v1:172.21.15.16:6837/220014269] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:45:54.891 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.888+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 msgr2=0x7fbfdc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.888+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 0x7fbfdc0b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009990 tx=0x7fbfe0009110 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.888+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 msgr2=0x7fbff0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.888+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006010 tx=0x7fbfe8031cb0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 shutdown_connections 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbfdc0b6510 0x7fbfdc0b8a20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff01051a0 0x7fbff0075c50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbff0104800 0x7fbff0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 --2- 172.21.15.16:0/1020125800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbff0103770 0x7fbff0076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 >> 172.21.15.16:0/1020125800 conn(0x7fbff00ff0c0 msgr2=0x7fbff0107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 shutdown_connections 2024-09-21T00:45:54.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:54.889+0000 7fbff497c640 1 -- 172.21.15.16:0/1020125800 wait complete. 2024-09-21T00:45:55.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:55 smithi016 ceph-mon[30947]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:55.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:55 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1020125800' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:45:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:55 smithi178 ceph-mon[34888]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:55.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:55 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1020125800' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:45:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:55 smithi123 ceph-mon[34853]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:55.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:55 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1020125800' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:45:55.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T00:45:55.874 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:56.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:56 smithi016 ceph-mon[30947]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T00:45:56.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:56 smithi178 ceph-mon[34888]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 -- 172.21.15.16:0/2447856224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20108cf0 msgr2=0x7f8b2010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2447856224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20108cf0 0x7f8b2010b110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009900 tx=0x7f8b1402a410 comp rx=0 tx=0).stop 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 -- 172.21.15.16:0/2447856224 shutdown_connections 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2447856224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2010b6a0 0x7f8b2010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2447856224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20108cf0 0x7f8b2010b110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2447856224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 0x7f8b201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 -- 172.21.15.16:0/2447856224 >> 172.21.15.16:0/2447856224 conn(0x7f8b200fdfd0 msgr2=0x7f8b20100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 -- 172.21.15.16:0/2447856224 shutdown_connections 2024-09-21T00:45:56.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.375+0000 7f8b2505c640 1 -- 172.21.15.16:0/2447856224 wait complete. 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.376+0000 7f8b2505c640 1 Processor -- start 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.376+0000 7f8b2505c640 1 -- start start 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 0x7f8b2019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 0x7f8b2019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201115e0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20111460 con 0x7f8b20108cf0 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b2505c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20111760 con 0x7f8b2006c4d0 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38500/0 (socket says 172.21.15.16:38500) 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 -- 172.21.15.16:0/2671819523 learned_addr learned my addr 172.21.15.16:0/2671819523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1ed9d640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 0x7f8b2019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:56.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1e59c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 0x7f8b2019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 -- 172.21.15.16:0/2671819523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 msgr2=0x7f8b2019c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 0x7f8b2019c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 -- 172.21.15.16:0/2671819523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 msgr2=0x7f8b2019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 0x7f8b2019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 -- 172.21.15.16:0/2671819523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2019dbd0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1e59c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 0x7f8b2019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.377+0000 7f8b1f59e640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800eaa0 tx=0x7f8b1800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.378+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18004d20 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.378+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2019dec0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.378+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b18005020 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.378+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b180116b0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.378+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b201a4480 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.379+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b200ffaf0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.380+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8b180051d0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.381+0000 7f8b07fff640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 0x7f8b080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.381+0000 7f8b1ed9d640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 0x7f8b080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.381+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8b180e74a0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.381+0000 7f8b1ed9d640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 0x7f8b080b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000abe0 tx=0x7f8b1000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:56.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.385+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b18016030 con 0x7f8b2010b6a0 2024-09-21T00:45:56.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:56 smithi123 ceph-mon[34853]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T00:45:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.575+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f8b20063fc0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.576+0000 7f8b07fff640 1 -- 172.21.15.16:0/2671819523 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5237 (secure 0 0 0) 0x7f8b180addc0 con 0x7f8b2010b6a0 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 75 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-09-21T00:35:57.524731+0000 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-09-21T00:44:47.793517+0000 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:crush_version 26 2024-09-21T00:45:56.577 INFO:teuthology.orchestra.run.smithi016.stdout:full_ratio 0.95 2024-09-21T00:45:56.578 INFO:teuthology.orchestra.run.smithi016.stdout:backfillfull_ratio 0.9 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:nearfull_ratio 0.85 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:require_min_compat_client luminous 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:min_compat_client luminous 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:require_osd_release squid 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:stretch_mode_enabled false 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:max_osd 12 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6802/1318446246,v1:172.21.15.16:6803/1318446246] [v2:172.21.15.16:6804/1318446246,v1:172.21.15.16:6805/1318446246] exists,up 5583349e-c367-4589-b3a7-a3912bb27cec 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 up in weight 1 up_from 13 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6800/2399482563,v1:172.21.15.123:6801/2399482563] [v2:172.21.15.123:6802/2399482563,v1:172.21.15.123:6803/2399482563] exists,up 999bcbd3-bb63-4e7c-b2e7-e41b2fb218df 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 up in weight 1 up_from 17 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6800/231892136,v1:172.21.15.178:6801/231892136] [v2:172.21.15.178:6802/231892136,v1:172.21.15.178:6803/231892136] exists,up b09b9ef0-4e02-4df8-9e16-876c52c027c5 2024-09-21T00:45:56.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 up in weight 1 up_from 23 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6810/1166375609,v1:172.21.15.16:6811/1166375609] [v2:172.21.15.16:6812/1166375609,v1:172.21.15.16:6813/1166375609] exists,up dda541c6-f1c3-40b9-8101-307d46151404 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 up in weight 1 up_from 28 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6808/1012246785,v1:172.21.15.123:6809/1012246785] [v2:172.21.15.123:6810/1012246785,v1:172.21.15.123:6811/1012246785] exists,up fb5b7ffd-58b4-4b23-9233-9821e51ddf23 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 up in weight 1 up_from 33 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6808/1751898506,v1:172.21.15.178:6809/1751898506] [v2:172.21.15.178:6810/1751898506,v1:172.21.15.178:6811/1751898506] exists,up 468ee4cb-31d6-402a-8d52-add13aaef32b 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 up in weight 1 up_from 39 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6818/562709826,v1:172.21.15.16:6819/562709826] [v2:172.21.15.16:6820/562709826,v1:172.21.15.16:6821/562709826] exists,up 8f6ffe0c-1477-4a08-9609-e7c559dfe280 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 up in weight 1 up_from 44 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6816/2228888488,v1:172.21.15.123:6817/2228888488] [v2:172.21.15.123:6818/2228888488,v1:172.21.15.123:6819/2228888488] exists,up 4555d360-ad10-49c0-9972-1b7b0ddde002 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.8 up in weight 1 up_from 50 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6816/3499718195,v1:172.21.15.178:6817/3499718195] [v2:172.21.15.178:6818/3499718195,v1:172.21.15.178:6819/3499718195] exists,up 70b08292-671a-4458-91a5-c07975068f65 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.9 up in weight 1 up_from 56 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6826/726892379,v1:172.21.15.16:6827/726892379] [v2:172.21.15.16:6828/726892379,v1:172.21.15.16:6829/726892379] exists,up 32770935-de25-4c09-b1dc-98c5aa14468f 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.10 up in weight 1 up_from 61 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6824/2298127239,v1:172.21.15.123:6825/2298127239] [v2:172.21.15.123:6826/2298127239,v1:172.21.15.123:6827/2298127239] exists,up 05aa564e-f675-4b5a-8acd-7324f35b015a 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6824/2747266489,v1:172.21.15.178:6825/2747266489] [v2:172.21.15.178:6826/2747266489,v1:172.21.15.178:6827/2747266489] exists,up 6769ceec-1b7b-4c94-a9e6-e8780afda9ce 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 2.0 [7,11] 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 2.c [2,4] 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 2.1d [8,11,2,1] 2024-09-21T00:45:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.1 [4,9] 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.11 [5,9] 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.36 [4,9] 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6801/2300615142 expires 2024-09-22T00:36:46.160526+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6800/2300615142 expires 2024-09-22T00:36:46.160526+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/2443520683 expires 2024-09-22T00:36:46.160526+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/1457328245 expires 2024-09-22T00:36:46.160526+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/4012921169 expires 2024-09-22T00:36:46.160526+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/1347629010 expires 2024-09-22T00:36:19.833384+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/3084433609 expires 2024-09-22T00:36:19.833384+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6801/3616915113 expires 2024-09-22T00:36:19.833384+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6800/3616915113 expires 2024-09-22T00:36:19.833384+0000 2024-09-21T00:45:56.581 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/2138679085 expires 2024-09-22T00:36:19.833384+0000 2024-09-21T00:45:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 msgr2=0x7f8b080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 0x7f8b080b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000abe0 tx=0x7f8b1000a2d0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 msgr2=0x7f8b2019d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800eaa0 tx=0x7f8b1800eea0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 shutdown_connections 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6510 0x7f8b080b8a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b2010b6a0 0x7f8b2019d440 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108cf0 0x7f8b2019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 --2- 172.21.15.16:0/2671819523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b2006c4d0 0x7f8b2019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 >> 172.21.15.16:0/2671819523 conn(0x7f8b200fdfd0 msgr2=0x7f8b20109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 shutdown_connections 2024-09-21T00:45:56.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:56.579+0000 7f8b2505c640 1 -- 172.21.15.16:0/2671819523 wait complete. 2024-09-21T00:45:57.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2671819523' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:45:57.285 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T00:45:57.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:45:57.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2671819523' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:45:57.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2671819523' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:45:57.557 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:58.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 -- 172.21.15.16:0/734277107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20103b60 msgr2=0x7fde20103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:58.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 --2- 172.21.15.16:0/734277107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20103b60 0x7fde20103f70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fde10009900 tx=0x7fde1002a410 comp rx=0 tx=0).stop 2024-09-21T00:45:58.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 -- 172.21.15.16:0/734277107 shutdown_connections 2024-09-21T00:45:58.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 --2- 172.21.15.16:0/734277107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20109df0 0x7fde20110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 --2- 172.21.15.16:0/734277107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 0x7fde201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 --2- 172.21.15.16:0/734277107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20103b60 0x7fde20103f70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 -- 172.21.15.16:0/734277107 >> 172.21.15.16:0/734277107 conn(0x7fde2007b850 msgr2=0x7fde2007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 -- 172.21.15.16:0/734277107 shutdown_connections 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.066+0000 7fde24fb3640 1 -- 172.21.15.16:0/734277107 wait complete. 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 Processor -- start 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 -- start start 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 0x7fde20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 0x7fde20075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde20113ab0 con 0x7fde20109df0 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fde20113930 con 0x7fde201094a0 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde24fb3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fde20113c30 con 0x7fde20103b60 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde1ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:58.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde1ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38518/0 (socket says 172.21.15.16:38518) 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde1ed9d640 1 -- 172.21.15.16:0/3181582839 learned_addr learned my addr 172.21.15.16:0/3181582839 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.067+0000 7fde1dd9b640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 0x7fde20075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1e59c640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 0x7fde20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 -- 172.21.15.16:0/3181582839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 msgr2=0x7fde20075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 0x7fde20075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 -- 172.21.15.16:0/3181582839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 msgr2=0x7fde20075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 0x7fde20075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 -- 172.21.15.16:0/3181582839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde201a8690 con 0x7fde20109df0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1e59c640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 0x7fde20075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde1ed9d640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde1800eb10 tx=0x7fde1800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1800ce20 con 0x7fde20109df0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde18005020 con 0x7fde20109df0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde201a8980 con 0x7fde20109df0 2024-09-21T00:45:58.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18010690 con 0x7fde20109df0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.068+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201a8ec0 con 0x7fde20109df0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.069+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde20103f70 con 0x7fde20109df0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.071+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fde18005510 con 0x7fde20109df0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.072+0000 7fde0f7fe640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 0x7fde080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.072+0000 7fde1e59c640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 0x7fde080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.072+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fde180e7d80 con 0x7fde20109df0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.072+0000 7fde1e59c640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 0x7fde080b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde10000c00 tx=0x7fde10009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.075+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde180ae600 con 0x7fde20109df0 2024-09-21T00:45:58.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:58 smithi016 ceph-mon[30947]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T00:45:58.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:58 smithi178 ceph-mon[34888]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T00:45:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.301+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde2002e640 con 0x7fde20109df0 2024-09-21T00:45:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.301+0000 7fde0f7fe640 1 -- 172.21.15.16:0/3181582839 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fde180b29e0 con 0x7fde20109df0 2024-09-21T00:45:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:45:58.303 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:45:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 msgr2=0x7fde080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 0x7fde080b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde10000c00 tx=0x7fde10009680 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 msgr2=0x7fde20076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde1800eb10 tx=0x7fde1800ef10 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 shutdown_connections 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fde080b6510 0x7fde080b8a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde20109df0 0x7fde20076190 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde201094a0 0x7fde20075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 --2- 172.21.15.16:0/3181582839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde20103b60 0x7fde20075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:58.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 >> 172.21.15.16:0/3181582839 conn(0x7fde2007b850 msgr2=0x7fde20107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:58.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 shutdown_connections 2024-09-21T00:45:58.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:58.304+0000 7fde24fb3640 1 -- 172.21.15.16:0/3181582839 wait complete. 2024-09-21T00:45:58.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:58 smithi123 ceph-mon[34853]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T00:45:58.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:45:59.252 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:45:59.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:45:59 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3181582839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:45:59 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3181582839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:59.536 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:45:59 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3181582839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 -- 172.21.15.16:0/4225528623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70102a60 msgr2=0x7ffb70102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 --2- 172.21.15.16:0/4225528623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70102a60 0x7ffb70102e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009ca0 tx=0x7ffb6002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 -- 172.21.15.16:0/4225528623 shutdown_connections 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 --2- 172.21.15.16:0/4225528623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb70108cf0 0x7ffb7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 --2- 172.21.15.16:0/4225528623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb701083a0 0x7ffb701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 --2- 172.21.15.16:0/4225528623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70102a60 0x7ffb70102e70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 -- 172.21.15.16:0/4225528623 >> 172.21.15.16:0/4225528623 conn(0x7ffb70079730 msgr2=0x7ffb70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 -- 172.21.15.16:0/4225528623 shutdown_connections 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.784+0000 7ffb784fd640 1 -- 172.21.15.16:0/4225528623 wait complete. 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.785+0000 7ffb784fd640 1 Processor -- start 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.785+0000 7ffb784fd640 1 -- start start 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.785+0000 7ffb784fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb70102a60 0x7ffb7019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.785+0000 7ffb784fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb701083a0 0x7ffb7019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70113a80 con 0x7ffb70108cf0 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70113900 con 0x7ffb70102a60 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70113c00 con 0x7ffb701083a0 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:59.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38526/0 (socket says 172.21.15.16:38526) 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 -- 172.21.15.16:0/3396046779 learned_addr learned my addr 172.21.15.16:0/3396046779 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb75a98640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb701083a0 0x7ffb7019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76299640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb70102a60 0x7ffb7019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 -- 172.21.15.16:0/3396046779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb701083a0 msgr2=0x7ffb7019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb701083a0 0x7ffb7019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 -- 172.21.15.16:0/3396046779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb70102a60 msgr2=0x7ffb7019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb70102a60 0x7ffb7019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 -- 172.21.15.16:0/3396046779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb701a0380 con 0x7ffb70108cf0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb76a9a640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d750 tx=0x7ffb6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68017070 con 0x7ffb70108cf0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701a0670 con 0x7ffb70108cf0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb680054d0 con 0x7ffb70108cf0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004c60 con 0x7ffb70108cf0 2024-09-21T00:45:59.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.786+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701a6dd0 con 0x7ffb70108cf0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.787+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb70102e70 con 0x7ffb70108cf0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.789+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffb68009bd0 con 0x7ffb70108cf0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.790+0000 7ffb6f7fe640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 0x7ffb580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.790+0000 7ffb76299640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 0x7ffb580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.790+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7ffb680e6fe0 con 0x7ffb70108cf0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.791+0000 7ffb76299640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 0x7ffb580b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009ca0 tx=0x7ffb60005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:45:59.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:45:59.794+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb680ad880 con 0x7ffb70108cf0 2024-09-21T00:46:00.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.020+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7019b540 con 0x7ffb70108cf0 2024-09-21T00:46:00.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.020+0000 7ffb6f7fe640 1 -- 172.21.15.16:0/3396046779 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7ffb680b1c60 con 0x7ffb70108cf0 2024-09-21T00:46:00.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:00.022 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-09-21T00:44:30:753491+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:44:30.753465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24644,24677,24625,24620,24613]},"id":1}]} 2024-09-21T00:46:00.022 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 msgr2=0x7ffb580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 0x7ffb580b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009ca0 tx=0x7ffb60005fd0 comp rx=0 tx=0).stop 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 msgr2=0x7ffb7019fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d750 tx=0x7ffb6800dc10 comp rx=0 tx=0).stop 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 shutdown_connections 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ffb580b6510 0x7ffb580b8a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:00.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70108cf0 0x7ffb7019fc50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:00.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb701083a0 0x7ffb7019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:00.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 --2- 172.21.15.16:0/3396046779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb70102a60 0x7ffb7019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:00.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 >> 172.21.15.16:0/3396046779 conn(0x7ffb70079730 msgr2=0x7ffb701013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:00.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 shutdown_connections 2024-09-21T00:46:00.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:00.023+0000 7ffb784fd640 1 -- 172.21.15.16:0/3396046779 wait complete. 2024-09-21T00:46:00.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:00 smithi016 ceph-mon[30947]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:46:00.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:00 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3396046779' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:00.421 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:00 smithi123 ceph-mon[34853]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:46:00.421 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:00 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3396046779' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:00.536 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:00 smithi178 ceph-mon[34888]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T00:46:00.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:00 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3396046779' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:00.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:46:01.101 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/2763121096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 msgr2=0x7f8cac1024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/2763121096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac1024b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009900 tx=0x7f8c9c02a410 comp rx=0 tx=0).stop 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/2763121096 shutdown_connections 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/2763121096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac109e40 0x7f8cac110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/2763121096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac1094f0 0x7f8cac109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/2763121096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac1024b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/2763121096 >> 172.21.15.16:0/2763121096 conn(0x7f8cac079e40 msgr2=0x7f8cac07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/2763121096 shutdown_connections 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.566+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/2763121096 wait complete. 2024-09-21T00:46:01.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 Processor -- start 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 -- start start 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac1094f0 0x7f8cac19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac109e40 0x7f8cac19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac113b60 con 0x7f8cac1020a0 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1139e0 con 0x7f8cac1094f0 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cb1ba9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac113ce0 con 0x7f8cac109e40 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38548/0 (socket says 172.21.15.16:38548) 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cab7fe640 1 -- 172.21.15.16:0/3212125924 learned_addr learned my addr 172.21.15.16:0/3212125924 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8caaffd640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac1094f0 0x7f8cac19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.567+0000 7f8cabfff640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac109e40 0x7f8cac19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 -- 172.21.15.16:0/3212125924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac109e40 msgr2=0x7f8cac19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac109e40 0x7f8cac19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 -- 172.21.15.16:0/3212125924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac1094f0 msgr2=0x7f8cac19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac1094f0 0x7f8cac19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 -- 172.21.15.16:0/3212125924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac1a04c0 con 0x7f8cac1020a0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cab7fe640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c03f030 con 0x7f8cac1020a0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c003800 con 0x7f8cac1020a0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac1a0750 con 0x7f8cac1020a0 2024-09-21T00:46:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c035070 con 0x7f8cac1020a0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.568+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1a6f10 con 0x7f8cac1020a0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.569+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cac1024b0 con 0x7f8cac1020a0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.571+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8c9c003cb0 con 0x7f8cac1020a0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.572+0000 7f8ca8ff9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 0x7f8c980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.572+0000 7f8caaffd640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 0x7f8c980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.572+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8c9c107e40 con 0x7f8cac1020a0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.572+0000 7f8caaffd640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 0x7f8c980b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1090e0 tx=0x7f8c9400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.575+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c9c0ce760 con 0x7f8cac1020a0 2024-09-21T00:46:01.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.767+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cac02e640 con 0x7f8cac1020a0 2024-09-21T00:46:01.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.768+0000 7f8ca8ff9640 1 -- 172.21.15.16:0/3212125924 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f8c9c0d2b40 con 0x7f8cac1020a0 2024-09-21T00:46:01.769 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:01.769 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:46:01.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 msgr2=0x7f8c980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:01.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 0x7f8c980b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1090e0 tx=0x7f8c9400a2d0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 msgr2=0x7f8cac19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c0042f0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 shutdown_connections 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8c980b6510 0x7f8c980b8a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cac109e40 0x7f8cac19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cac1094f0 0x7f8cac19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 --2- 172.21.15.16:0/3212125924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cac1020a0 0x7f8cac19a550 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 >> 172.21.15.16:0/3212125924 conn(0x7f8cac079e40 msgr2=0x7f8cac107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 shutdown_connections 2024-09-21T00:46:01.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:01.770+0000 7f8cb1ba9640 1 -- 172.21.15.16:0/3212125924 wait complete. 2024-09-21T00:46:02.339 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:02 smithi178 ceph-mon[34888]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:02.339 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:02 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3212125924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:02.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:02 smithi016 ceph-mon[30947]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:02.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:02 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3212125924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:02.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:44:18.388808+0000', 'modified': '2024-09-21T00:44:30.753465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24677, 'mds_1': 24644, 'mds_2': 24625, 'mds_3': 24620, 'mds_4': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14778': {'gid': 14778, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6839/3052513368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6838', 'nonce': 3052513368}, {'type': 'v1', 'addr': '172.21.15.16:6839', 'nonce': 3052513368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14790': {'gid': 14790, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6841/1186818130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6840', 'nonce': 1186818130}, {'type': 'v1', 'addr': '172.21.15.16:6841', 'nonce': 1186818130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/2278158780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 2278158780}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 2278158780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24587': {'gid': 24587, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6833/2611682237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6832', 'nonce': 2611682237}, {'type': 'v1', 'addr': '172.21.15.123:6833', 'nonce': 2611682237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/4194574330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 4194574330}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 4194574330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.178:6837/795211231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 795211231}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 795211231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.123:6835/1315446944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1315446944}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1315446944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.178:6839/3738575776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 3738575776}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 3738575776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24644': {'gid': 24644, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.123:6837/2648060982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2648060982}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2648060982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24677': {'gid': 24677, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/760564744', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 760564744}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 760564744}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24677, 'qdb_cluster': [24644, 24677, 24625, 24620, 24613]} 2024-09-21T00:46:02.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T00:46:02.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T00:46:02.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:02 smithi123 ceph-mon[34853]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:02.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:02 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3212125924' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:03.201 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:03 smithi016 ceph-mon[30947]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 -- 172.21.15.16:0/1796419952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 msgr2=0x7fdf981098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1796419952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf981098d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009900 tx=0x7fdf8c02a410 comp rx=0 tx=0).stop 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 -- 172.21.15.16:0/1796419952 shutdown_connections 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1796419952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98109e10 0x7fdf98110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1796419952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf981098d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1796419952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98103b80 0x7fdf98103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 -- 172.21.15.16:0/1796419952 >> 172.21.15.16:0/1796419952 conn(0x7fdf980ff610 msgr2=0x7fdf98101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 -- 172.21.15.16:0/1796419952 shutdown_connections 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.294+0000 7fdf9e839640 1 -- 172.21.15.16:0/1796419952 wait complete. 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 Processor -- start 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 -- start start 2024-09-21T00:46:03.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 0x7fdf9819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 0x7fdf9819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98113ad0 con 0x7fdf981094c0 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98113950 con 0x7fdf98109e10 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.295+0000 7fdf9e839640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98113c50 con 0x7fdf98103b80 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38568/0 (socket says 172.21.15.16:38568) 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 -- 172.21.15.16:0/1826476750 learned_addr learned my addr 172.21.15.16:0/1826476750 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf97fff640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 0x7fdf9819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 0x7fdf9819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 -- 172.21.15.16:0/1826476750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 msgr2=0x7fdf9819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 0x7fdf9819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 -- 172.21.15.16:0/1826476750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 msgr2=0x7fdf9819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 0x7fdf9819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 -- 172.21.15.16:0/1826476750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf981a0410 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 0x7fdf9819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf97fff640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 0x7fdf9819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c02a930 tx=0x7fdf8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf957fa640 1 -- 172.21.15.16:0/1826476750 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c03f030 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf957fa640 1 -- 172.21.15.16:0/1826476750 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf8c003aa0 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf981a06a0 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf957fa640 1 -- 172.21.15.16:0/1826476750 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c035070 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.296+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf981a6e60 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.299+0000 7fdf957fa640 1 -- 172.21.15.16:0/1826476750 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdf8c042030 con 0x7fdf981094c0 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.299+0000 7fdfa4dad740 1 Processor -- start 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.299+0000 7fdfa4dad740 1 -- start start 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 0x5585c36b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585c362ac10 con 0x5585c330cf60 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585c361a040 con 0x5585c32e40a0 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5585c361de50 con 0x5585c32ec280 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38574/0 (socket says 172.21.15.16:38574) 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/2230586520 learned_addr learned my addr 172.21.15.16:0/2230586520 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf97fff640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf977fe640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 0x5585c36b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf957fa640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 0x7fdf800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/2230586520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 msgr2=0x5585c36b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 0x5585c36b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/2230586520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 msgr2=0x5585c36b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/2230586520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c3378540 con 0x5585c330cf60 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf977fe640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 0x5585c36b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 0x7fdf800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.300+0000 7fdf957fa640 1 -- 172.21.15.16:0/1826476750 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdf8c1079e0 con 0x7fdf981094c0 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.301+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009fa0 tx=0x7fdf9000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f452a4e8ed1b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.301+0000 7fdf7e7fc640 1 -- 172.21.15.16:0/2230586520 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9001a610 con 0x5585c330cf60 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.301+0000 7fdf7e7fc640 1 -- 172.21.15.16:0/2230586520 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf9001ac60 con 0x5585c330cf60 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.301+0000 7fdf7e7fc640 1 -- 172.21.15.16:0/2230586520 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90010890 con 0x5585c330cf60 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- 172.21.15.16:0/2230586520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 msgr2=0x5585c36b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 0x7fdf800b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdf90020000 tx=0x7fdf9001d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009fa0 tx=0x7fdf9000f7f0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- 172.21.15.16:0/2230586520 shutdown_connections 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32ec280 0x5585c36b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/2230586520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36b2f00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- 172.21.15.16:0/2230586520 >> 172.21.15.16:0/2230586520 conn(0x5585c3301350 msgr2=0x5585c36b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- 172.21.15.16:0/2230586520 shutdown_connections 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- 172.21.15.16:0/2230586520 wait complete. 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.302+0000 7fdfa4dad740 1 -- start start 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 Processor -- start 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585c347b5f0 con 0x5585c32ec280 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585c35b5010 con 0x5585c32e40a0 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5585c36c16e0 con 0x5585c330cf60 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdfa4dad740 10 client.0 _ll_register_callbacks cb 0x5585c3614340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38588/0 (socket says 172.21.15.16:38588) 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 -- 172.21.15.16:0/1754149229 learned_addr learned my addr 172.21.15.16:0/1754149229 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf97fff640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 -- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 msgr2=0x5585c36caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 -- 172.21.15.16:0/1754149229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 msgr2=0x5585c36beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36beaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf977fe640 1 -- 172.21.15.16:0/1754149229 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c35e2a00 con 0x5585c32ec280 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.303+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf977fe640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ca1d0 tx=0x7fdf8c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f0586b4ab94b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c049030 con 0x5585c32ec280 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdf8c0c9e70 con 0x5585c32ec280 2024-09-21T00:46:03.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf9001ac60 con 0x5585c32ec280 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf8c0cd710 con 0x5585c32ec280 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 10 client.15306 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585c36cd6f0 con 0x5585c32ec280 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf9001ac60 con 0x5585c32ec280 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdf8c0f10b0 con 0x5585c32ec280 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 10 client.15306 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 10 client.15306 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 20 client.15306 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32cb8e0 0x5585c36d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 4 client.15306 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.304+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585c362cb60 con 0x5585c32cb8e0 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.305+0000 7fdf97fff640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32cb8e0 0x5585c36d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.305+0000 7fdf777fe640 10 client.15306 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:46:03.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.305+0000 7fdf97fff640 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32cb8e0 0x5585c36d11a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aaeab3cf81e033e server_cookie=ee924baed3083470 in_seq=0 out_seq=0 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdf777fe640 1 -- 172.21.15.16:0/1754149229 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585c362cb60 con 0x5585c32cb8e0 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdf777fe640 10 client.15306 handle_command_reply: tid=0 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 client.15306 shutdown 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 msgr2=0x5585c36bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ca1d0 tx=0x7fdf8c02a410 comp rx=0 tx=0).stop 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 shutdown_connections 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32cb8e0 0x5585c36d11a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32ec280 0x5585c36bf030 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/1754149229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32e40a0 0x5585c36beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 >> 172.21.15.16:0/1754149229 conn(0x5585c3301350 msgr2=0x5585c36b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.306+0000 7fdf777fe640 0 client.15306 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.307+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 shutdown_connections 2024-09-21T00:46:03.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.307+0000 7fdfa4dad740 1 -- 172.21.15.16:0/1754149229 wait complete. 2024-09-21T00:46:03.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.307+0000 7fdfa4dad740 20 client.15306 trim_cache size 0 max 16384 2024-09-21T00:46:03.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 Processor -- start 2024-09-21T00:46:03.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 -- start start 2024-09-21T00:46:03.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585c36cf4e0 con 0x5585c32e40a0 2024-09-21T00:46:03.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585c36cfbb0 con 0x5585c32ec280 2024-09-21T00:46:03.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5585c36d0280 con 0x5585c330cf60 2024-09-21T00:46:03.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38600/0 (socket says 172.21.15.16:38600) 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 -- 172.21.15.16:0/96756132 learned_addr learned my addr 172.21.15.16:0/96756132 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf977fe640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 -- 172.21.15.16:0/96756132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 msgr2=0x5585c36b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 -- 172.21.15.16:0/96756132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 msgr2=0x5585c36b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf97fff640 1 -- 172.21.15.16:0/96756132 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c36b5420 con 0x5585c32e40a0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.326+0000 7fdf977fe640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.327+0000 7fdf97fff640 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5585c36b1b80 tx=0x7fdf8800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60feeed07e1c392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.327+0000 7fdf7dffb640 1 -- 172.21.15.16:0/96756132 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88003be0 con 0x5585c32e40a0 2024-09-21T00:46:03.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.327+0000 7fdf7dffb640 1 -- 172.21.15.16:0/96756132 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88003d80 con 0x5585c32e40a0 2024-09-21T00:46:03.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.327+0000 7fdf7dffb640 1 -- 172.21.15.16:0/96756132 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88004e30 con 0x5585c32e40a0 2024-09-21T00:46:03.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- 172.21.15.16:0/96756132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 msgr2=0x5585c36ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5585c36b1b80 tx=0x7fdf8800bdf0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- 172.21.15.16:0/96756132 shutdown_connections 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c330cf60 0x5585c36b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/96756132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c32e40a0 0x5585c36ca970 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- 172.21.15.16:0/96756132 >> 172.21.15.16:0/96756132 conn(0x5585c3301350 msgr2=0x5585c36cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- 172.21.15.16:0/96756132 shutdown_connections 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- 172.21.15.16:0/96756132 wait complete. 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.328+0000 7fdfa4dad740 1 -- start start 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 Processor -- start 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32e40a0 0x5585c36d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585c36d1020 con 0x5585c330cf60 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5585c36d0950 con 0x5585c32ec280 2024-09-21T00:46:03.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5585c36d16f0 con 0x5585c32e40a0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdfa4dad740 10 client.0 _ll_register_callbacks cb 0x7fdf8c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38608/0 (socket says 172.21.15.16:38608) 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/3159669952 learned_addr learned my addr 172.21.15.16:0/3159669952 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf97fff640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32e40a0 0x5585c36d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf977fe640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32e40a0 msgr2=0x5585c36d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32e40a0 0x5585c36d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/3159669952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 msgr2=0x5585c36d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf9cdd6640 1 -- 172.21.15.16:0/3159669952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c36d4400 con 0x5585c330cf60 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.329+0000 7fdf977fe640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf9cdd6640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009ef0 tx=0x7fdf900122f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d1682436d48926 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:03.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf900107e0 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf88003d80 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdf90030460 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf90009af0 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdfa4dad740 10 client.15312 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585c373cb80 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88003d80 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdf90025440 con 0x5585c330cf60 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.330+0000 7fdfa4dad740 10 client.15312 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdfa4dad740 10 client.15312 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdfa4dad740 20 client.15312 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32a0c90 0x5585c37401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdfa4dad740 4 client.15312 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:46:03.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "status"}) -- 0x5585c3628610 con 0x5585c32a0c90 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdf97fff640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32a0c90 0x5585c37401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdf97fff640 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32a0c90 0x5585c37401d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4e77b3f36fb0f5f9 server_cookie=c72b021414823291 in_seq=0 out_seq=0 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.331+0000 7fdf777fe640 10 client.15312 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdf777fe640 1 -- 172.21.15.16:0/3159669952 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5585c3628610 con 0x5585c32a0c90 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdf777fe640 10 client.15312 handle_command_reply: tid=0 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 client.15312 shutdown 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 msgr2=0x5585c36d8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009ef0 tx=0x7fdf900122f0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 shutdown_connections 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5585c32a0c90 0x5585c37401d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585c330cf60 0x5585c36d8e10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5585c32ec280 0x5585c36d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 --2- 172.21.15.16:0/3159669952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5585c32e40a0 0x5585c36d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 >> 172.21.15.16:0/3159669952 conn(0x5585c3301350 msgr2=0x5585c36cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdf777fe640 0 client.15312 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 shutdown_connections 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 1 -- 172.21.15.16:0/3159669952 wait complete. 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.332+0000 7fdfa4dad740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 4, 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24613, 2024-09-21T00:46:03.339 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 93.589779011999994, 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 130.64426360499999 2024-09-21T00:46:03.340 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 msgr2=0x7fdf800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 0x7fdf800b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdf90020000 tx=0x7fdf9001d000 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 msgr2=0x7fdf9819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c02a930 tx=0x7fdf8c004270 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 shutdown_connections 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdf800b6510 0x7fdf800b8a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf98109e10 0x7fdf9819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf981094c0 0x7fdf9819aa40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 --2- 172.21.15.16:0/1826476750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf98103b80 0x7fdf9819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 >> 172.21.15.16:0/1826476750 conn(0x7fdf980ff610 msgr2=0x7fdf98101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:03.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 shutdown_connections 2024-09-21T00:46:03.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:03.333+0000 7fdf9e839640 1 -- 172.21.15.16:0/1826476750 wait complete. 2024-09-21T00:46:03.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:03 smithi123 ceph-mon[34853]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:46:03.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:03 smithi178 ceph-mon[34888]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:46:04.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.e status 2024-09-21T00:46:04.316 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 -- 172.21.15.16:0/1570420216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe810103b60 msgr2=0x7fe810103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 --2- 172.21.15.16:0/1570420216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe810103b60 0x7fe810103f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009900 tx=0x7fe80c02a3f0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 -- 172.21.15.16:0/1570420216 shutdown_connections 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 --2- 172.21.15.16:0/1570420216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810109df0 0x7fe810110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 --2- 172.21.15.16:0/1570420216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8101094a0 0x7fe8101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 --2- 172.21.15.16:0/1570420216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe810103b60 0x7fe810103f70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 -- 172.21.15.16:0/1570420216 >> 172.21.15.16:0/1570420216 conn(0x7fe81007b850 msgr2=0x7fe81007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 -- 172.21.15.16:0/1570420216 shutdown_connections 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.753+0000 7fe817d60640 1 -- 172.21.15.16:0/1570420216 wait complete. 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.754+0000 7fe817d60640 1 Processor -- start 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.754+0000 7fe817d60640 1 -- start start 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 0x7fe81019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 0x7fe81019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe810113ab0 con 0x7fe8101094a0 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe810113930 con 0x7fe810109df0 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe817d60640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe810113c30 con 0x7fe810103b60 2024-09-21T00:46:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52918/0 (socket says 172.21.15.16:52918) 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 -- 172.21.15.16:0/3203671472 learned_addr learned my addr 172.21.15.16:0/3203671472 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe815afc640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 0x7fe81019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8162fd640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 0x7fe81019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 -- 172.21.15.16:0/3203671472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 msgr2=0x7fe81019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 0x7fe81019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 -- 172.21.15.16:0/3203671472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 msgr2=0x7fe81019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 0x7fe81019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 -- 172.21.15.16:0/3203671472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101a0410 con 0x7fe8101094a0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe815afc640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 0x7fe81019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8162fd640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 0x7fe81019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.755+0000 7fe8152fb640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c8c0 tx=0x7fe80000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.756+0000 7fe806ffd640 1 -- 172.21.15.16:0/3203671472 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800007bb0 con 0x7fe8101094a0 2024-09-21T00:46:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.756+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8101a0700 con 0x7fe8101094a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.756+0000 7fe806ffd640 1 -- 172.21.15.16:0/3203671472 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe800007d50 con 0x7fe8101094a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.756+0000 7fe806ffd640 1 -- 172.21.15.16:0/3203671472 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8000187c0 con 0x7fe8101094a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.756+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101a6f20 con 0x7fe8101094a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.758+0000 7fe81e2d4740 1 Processor -- start 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 -- start start 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe806ffd640 1 -- 172.21.15.16:0/3203671472 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe80000fa20 con 0x7fe8101094a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae4df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae4e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5648fadc5c10 con 0x5648faa7f0a0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5648fadb5040 con 0x5648faaa7f60 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5648fadb8e50 con 0x5648faa87280 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52922/0 (socket says 172.21.15.16:52922) 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe815afc640 1 -- 172.21.15.16:0/189284379 learned_addr learned my addr 172.21.15.16:0/189284379 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe8162fd640 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae4df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.759+0000 7fe8152fb640 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae4e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 -- 172.21.15.16:0/189284379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 msgr2=0x5648fae4e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae4e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 -- 172.21.15.16:0/189284379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 msgr2=0x5648fae4df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae4df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 -- 172.21.15.16:0/189284379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fab13540 con 0x5648faa7f0a0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe815afc640 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009900 tx=0x7fe80c032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea54613cea2a1522 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe7fbfff640 1 -- 172.21.15.16:0/189284379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c03f070 con 0x5648faa7f0a0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe806ffd640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 0x7fe7fc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe7fbfff640 1 -- 172.21.15.16:0/189284379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c0316a0 con 0x5648faa7f0a0 2024-09-21T00:46:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe7fbfff640 1 -- 172.21.15.16:0/189284379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c035070 con 0x5648faa7f0a0 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe8162fd640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 0x7fe7fc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.760+0000 7fe806ffd640 1 -- 172.21.15.16:0/3203671472 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe8000e73e0 con 0x7fe8101094a0 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 -- 172.21.15.16:0/189284379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 msgr2=0x5648fae4e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe8162fd640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 0x7fe7fc0b8a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe808009370 tx=0x7fe808009720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009900 tx=0x7fe80c032e70 comp rx=0 tx=0).stop 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 -- 172.21.15.16:0/189284379 shutdown_connections 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae4e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae4e440 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/189284379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae4df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.761+0000 7fe81e2d4740 1 -- 172.21.15.16:0/189284379 >> 172.21.15.16:0/189284379 conn(0x5648faa9c350 msgr2=0x5648fae4bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.762+0000 7fe81e2d4740 1 -- 172.21.15.16:0/189284379 shutdown_connections 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.762+0000 7fe81e2d4740 1 -- 172.21.15.16:0/189284379 wait complete. 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.762+0000 7fe81e2d4740 1 -- start start 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.762+0000 7fe81e2d4740 1 Processor -- start 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 0x5648fae5de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae69d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5648fac165f0 con 0x5648faa87280 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5648fad50010 con 0x5648faa7f0a0 2024-09-21T00:46:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5648fae609e0 con 0x5648faaa7f60 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe81e2d4740 10 client.0 _ll_register_callbacks cb 0x5648fadaf340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52936/0 (socket says 172.21.15.16:52936) 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 -- 172.21.15.16:0/45680910 learned_addr learned my addr 172.21.15.16:0/45680910 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe815afc640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 0x5648fae5de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8162fd640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 -- 172.21.15.16:0/45680910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 msgr2=0x5648fae69d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae69d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 -- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 msgr2=0x5648fae5de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 0x5648fae5de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 -- 172.21.15.16:0/45680910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fad7da00 con 0x5648faa87280 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe815afc640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 0x5648fae5de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe8152fb640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c890 tx=0x7fe8000a95d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdc5a4aefe83190 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.763+0000 7fe7f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8000ad110 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe8000b6040 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80c0316a0 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8000add00 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 10 client.15324 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648fae6c990 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c0316a0 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe8000a9070 con 0x5648faa87280 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 10 client.15324 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 10 client.15324 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 20 client.15324 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa668e0 0x5648fae703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 4 client.15324 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.764+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648fadc7b60 con 0x5648faa668e0 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.765+0000 7fe815afc640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa668e0 0x5648fae703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.765+0000 7fe7f97fa640 10 client.15324 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.765+0000 7fe815afc640 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa668e0 0x5648fae703c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3a782961e3e9db9a server_cookie=547e78ef24729f5a in_seq=0 out_seq=0 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe7f97fa640 1 -- 172.21.15.16:0/45680910 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648fadc7b60 con 0x5648faa668e0 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe7f97fa640 10 client.15324 handle_command_reply: tid=0 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 client.15324 shutdown 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 msgr2=0x5648fae5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c890 tx=0x7fe8000a95d0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 shutdown_connections 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa668e0 0x5648fae703c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa87280 0x5648fae5e370 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe7f97fa640 0 client.15324 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:46:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/45680910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa7f0a0 0x5648fae5de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.766+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 >> 172.21.15.16:0/45680910 conn(0x5648faa9c350 msgr2=0x5648fae4a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.767+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 shutdown_connections 2024-09-21T00:46:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.767+0000 7fe81e2d4740 1 -- 172.21.15.16:0/45680910 wait complete. 2024-09-21T00:46:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.767+0000 7fe81e2d4740 20 client.15324 trim_cache size 0 max 16384 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 Processor -- start 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 -- start start 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 0x5648fae6a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae4a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5648fae6e700 con 0x5648faa7f0a0 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5648fae6edd0 con 0x5648faa87280 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5648fae6f4a0 con 0x5648faaa7f60 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52948/0 (socket says 172.21.15.16:52948) 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe815afc640 1 -- 172.21.15.16:0/4215740169 learned_addr learned my addr 172.21.15.16:0/4215740169 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe8162fd640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae4a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.785+0000 7fe8152fb640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 0x5648fae6a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 -- 172.21.15.16:0/4215740169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 msgr2=0x5648fae4a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae4a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 -- 172.21.15.16:0/4215740169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 msgr2=0x5648fae6a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 0x5648fae6a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 -- 172.21.15.16:0/4215740169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fae50810 con 0x5648faa7f0a0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe8152fb640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 0x5648fae6a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe815afc640 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0053b0 tx=0x7fe80c005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3e0df0d715cb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe7fb7fe640 1 -- 172.21.15.16:0/4215740169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c03f070 con 0x5648faa7f0a0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe7fb7fe640 1 -- 172.21.15.16:0/4215740169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c0054f0 con 0x5648faa7f0a0 2024-09-21T00:46:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.786+0000 7fe7fb7fe640 1 -- 172.21.15.16:0/4215740169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c035040 con 0x5648faa7f0a0 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- 172.21.15.16:0/4215740169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 msgr2=0x5648fae69cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0053b0 tx=0x7fe80c005480 comp rx=0 tx=0).stop 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- 172.21.15.16:0/4215740169 shutdown_connections 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faaa7f60 0x5648fae4a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faa87280 0x5648fae6a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/4215740169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae69cb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- 172.21.15.16:0/4215740169 >> 172.21.15.16:0/4215740169 conn(0x5648faa9c350 msgr2=0x5648fae5c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- 172.21.15.16:0/4215740169 shutdown_connections 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- 172.21.15.16:0/4215740169 wait complete. 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 -- start start 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.787+0000 7fe81e2d4740 1 Processor -- start 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae72bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5648fae70240 con 0x5648faa7f0a0 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5648fae6fb70 con 0x5648faaa7f60 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5648fae70910 con 0x5648faa87280 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe81e2d4740 10 client.0 _ll_register_callbacks cb 0x7fe8000eaa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe815afc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52956/0 (socket says 172.21.15.16:52956) 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe815afc640 1 -- 172.21.15.16:0/1428865920 learned_addr learned my addr 172.21.15.16:0/1428865920 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe8162fd640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.788+0000 7fe8152fb640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae72bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 -- 172.21.15.16:0/1428865920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 msgr2=0x5648fae72bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae72bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 -- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 msgr2=0x5648fae730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 -- 172.21.15.16:0/1428865920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fae77e30 con 0x5648faa7f0a0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe815afc640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe80c003910 tx=0x7fe80c0053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eba72738aa9fba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe7f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c05c020 con 0x5648faa7f0a0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe80c031b10 con 0x5648faa7f0a0 2024-09-21T00:46:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80c0054f0 con 0x5648faa7f0a0 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe80c067050 con 0x5648faa7f0a0 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe81e2d4740 10 client.15330 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648faedbaa0 con 0x5648faa7f0a0 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.789+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c0054f0 con 0x5648faa7f0a0 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe80c054450 con 0x5648faa7f0a0 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 10 client.15330 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 10 client.15330 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 20 client.15330 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa3bc90 0x5648faeded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 4 client.15330 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "status"}) -- 0x5648fadc3610 con 0x5648faa3bc90 2024-09-21T00:46:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.790+0000 7fe8152fb640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa3bc90 0x5648faeded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:04.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe7f97fa640 10 client.15330 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:46:04.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe8152fb640 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa3bc90 0x5648faeded10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a95b281719e0168e server_cookie=ec9589e0e8cbc2da in_seq=0 out_seq=0 2024-09-21T00:46:04.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe7f97fa640 1 -- 172.21.15.16:0/1428865920 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5648fadc3610 con 0x5648faa3bc90 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe7f97fa640 10 client.15330 handle_command_reply: tid=0 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 client.15330 shutdown 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 msgr2=0x5648fae72670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe80c003910 tx=0x7fe80c0053e0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 shutdown_connections 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5648faa3bc90 0x5648faeded10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5648faaa7f60 0x5648fae730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648faa87280 0x5648fae72bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 --2- 172.21.15.16:0/1428865920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648faa7f0a0 0x5648fae72670 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe7f97fa640 0 client.15330 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 >> 172.21.15.16:0/1428865920 conn(0x5648faa9c350 msgr2=0x5648fae530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 shutdown_connections 2024-09-21T00:46:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 1 -- 172.21.15.16:0/1428865920 wait complete. 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.791+0000 7fe81e2d4740 20 client.15330 trim_cache size 0 max 16384 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 3, 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24620, 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 96.055266473000003, 2024-09-21T00:46:04.797 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 137.285311992 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 msgr2=0x7fe7fc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 0x7fe7fc0b8a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe808009370 tx=0x7fe808009720 comp rx=0 tx=0).stop 2024-09-21T00:46:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 msgr2=0x7fe81019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c8c0 tx=0x7fe80000cd80 comp rx=0 tx=0).stop 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 shutdown_connections 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe7fc0b6540 0x7fe7fc0b8a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe810109df0 0x7fe81019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8101094a0 0x7fe81019ab00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 --2- 172.21.15.16:0/3203671472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe810103b60 0x7fe81019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 >> 172.21.15.16:0/3203671472 conn(0x7fe81007b850 msgr2=0x7fe810107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 shutdown_connections 2024-09-21T00:46:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:04.792+0000 7fe817d60640 1 -- 172.21.15.16:0/3203671472 wait complete. 2024-09-21T00:46:05.507 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:05 smithi016 ceph-mon[30947]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:05.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T00:46:05.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:05 smithi123 ceph-mon[34853]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:05.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:05 smithi178 ceph-mon[34888]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:05.798 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 -- 172.21.15.16:0/83406433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e810de90 msgr2=0x7fa4e8110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/83406433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e810de90 0x7fa4e8110380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009ca0 tx=0x7fa4e002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 -- 172.21.15.16:0/83406433 shutdown_connections 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/83406433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e810de90 0x7fa4e8110380 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/83406433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e8105380 0x7fa4e810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/83406433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 0x7fa4e8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 -- 172.21.15.16:0/83406433 >> 172.21.15.16:0/83406433 conn(0x7fa4e8079770 msgr2=0x7fa4e8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 -- 172.21.15.16:0/83406433 shutdown_connections 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.294+0000 7fa4ee26d640 1 -- 172.21.15.16:0/83406433 wait complete. 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 Processor -- start 2024-09-21T00:46:06.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 -- start start 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 0x7fa4e819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e810de90 0x7fa4e819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8113b90 con 0x7fa4e8105380 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8113a10 con 0x7fa4e8104a30 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ee26d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8113d10 con 0x7fa4e810de90 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52984/0 (socket says 172.21.15.16:52984) 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4dffff640 1 -- 172.21.15.16:0/1937195271 learned_addr learned my addr 172.21.15.16:0/1937195271 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 0x7fa4e819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e810de90 0x7fa4e819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.295+0000 7fa4dffff640 1 -- 172.21.15.16:0/1937195271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e810de90 msgr2=0x7fa4e819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4dffff640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e810de90 0x7fa4e819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4dffff640 1 -- 172.21.15.16:0/1937195271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 msgr2=0x7fa4e819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4dffff640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 0x7fa4e819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4dffff640 1 -- 172.21.15.16:0/1937195271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e81a04b0 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4dffff640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c970 tx=0x7fa4d000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1937195271 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0004220 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e81a07a0 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1937195271 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d00043c0 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1937195271 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0004a00 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.296+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e81a6f00 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 Processor -- start 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 -- start start 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1937195271 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa4d00079b0 con 0x7fa4e8105380 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d81f60 0x55d6d5127f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5128440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d6d509fc10 con 0x55d6d4d61280 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6d508f040 con 0x55d6d4d590a0 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5092e50 con 0x55d6d4d81f60 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52986/0 (socket says 172.21.15.16:52986) 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4dffff640 1 -- 172.21.15.16:0/830096821 learned_addr learned my addr 172.21.15.16:0/830096821 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5128440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.299+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d81f60 0x55d6d5127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 -- 172.21.15.16:0/830096821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d81f60 msgr2=0x55d6d5127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d81f60 0x55d6d5127f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 -- 172.21.15.16:0/830096821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 msgr2=0x55d6d5128440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5128440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 -- 172.21.15.16:0/830096821 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d4ded540 con 0x55d6d4d61280 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4dffff640 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ef190 tx=0x7fa4d00ef650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e2311da687fa9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4e5ffb640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 0x7fa4d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 0x7fa4d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4de7fc640 1 -- 172.21.15.16:0/830096821 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00fa070 con 0x55d6d4d61280 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4de7fc640 1 -- 172.21.15.16:0/830096821 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d00acc60 con 0x55d6d4d61280 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4de7fc640 1 -- 172.21.15.16:0/830096821 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00a97a0 con 0x55d6d4d61280 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.300+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1937195271 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa4d00e6f30 con 0x7fa4e8105380 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- 172.21.15.16:0/830096821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 msgr2=0x55d6d5128980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ef190 tx=0x7fa4d00ef650 comp rx=0 tx=0).stop 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 0x7fa4d40b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00094e0 tx=0x7fa4e002f3a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- 172.21.15.16:0/830096821 shutdown_connections 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5128980 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5128440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/830096821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d81f60 0x55d6d5127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- 172.21.15.16:0/830096821 >> 172.21.15.16:0/830096821 conn(0x55d6d4d76350 msgr2=0x55d6d5125df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- 172.21.15.16:0/830096821 shutdown_connections 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- 172.21.15.16:0/830096821 wait complete. 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.301+0000 7fa4f47e1740 1 -- start start 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 Processor -- start 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d590a0 0x55d6d5137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d81f60 0x55d6d5143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d6d4ef05f0 con 0x55d6d4d61280 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6d502a010 con 0x55d6d4d81f60 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6d513aa10 con 0x55d6d4d590a0 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4f47e1740 10 client.0 _ll_register_callbacks cb 0x55d6d5089340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:06.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52994/0 (socket says 172.21.15.16:52994) 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 -- 172.21.15.16:0/2328580795 learned_addr learned my addr 172.21.15.16:0/2328580795 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d81f60 0x55d6d5143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d590a0 0x55d6d5137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 -- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d590a0 msgr2=0x55d6d5137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d590a0 0x55d6d5137b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 -- 172.21.15.16:0/2328580795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d81f60 msgr2=0x55d6d5143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d81f60 0x55d6d5143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.302+0000 7fa4dffff640 1 -- 172.21.15.16:0/2328580795 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d5057a00 con 0x55d6d4d61280 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4dffff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad0e0 tx=0x7fa4d00e7250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef04403d441dd196 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0052930 con 0x55d6d4d61280 2024-09-21T00:46:06.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa4d00eabc0 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d00acc60 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4d0051cb0 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 10 client.15342 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d6d51468e0 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d00acc60 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d00ac3b0 con 0x55d6d4d61280 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 10 client.15342 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 10 client.15342 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 20 client.15342 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.303+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d408e0 0x55d6d5147c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.304+0000 7fa4f47e1740 4 client.15342 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.304+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6d50a1b60 con 0x55d6d4d408e0 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.304+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d408e0 0x55d6d5147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.304+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d408e0 0x55d6d5147c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e96ed9893386772 server_cookie=b9e6370d8aba9e47 in_seq=0 out_seq=0 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.304+0000 7fa4c77fe640 10 client.15342 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4c77fe640 1 -- 172.21.15.16:0/2328580795 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6d50a1b60 con 0x55d6d4d408e0 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4c77fe640 10 client.15342 handle_command_reply: tid=0 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 client.15342 shutdown 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 msgr2=0x55d6d5138090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad0e0 tx=0x7fa4d00e7250 comp rx=0 tx=0).stop 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 shutdown_connections 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d81f60 0x55d6d5143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d408e0 0x55d6d5147c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4c77fe640 0 client.15342 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d61280 0x55d6d5138090 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/2328580795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d590a0 0x55d6d5137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.305+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 >> 172.21.15.16:0/2328580795 conn(0x55d6d4d76350 msgr2=0x55d6d512b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.306+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 shutdown_connections 2024-09-21T00:46:06.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.306+0000 7fa4f47e1740 1 -- 172.21.15.16:0/2328580795 wait complete. 2024-09-21T00:46:06.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.306+0000 7fa4f47e1740 20 client.15342 trim_cache size 0 max 16384 2024-09-21T00:46:06.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 Processor -- start 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 -- start start 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5124ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d5143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5148180 con 0x55d6d4d408e0 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5148850 con 0x55d6d4d590a0 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5148f20 con 0x55d6d4d61280 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53004/0 (socket says 172.21.15.16:53004) 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.324+0000 7fa4e7fff640 1 -- 172.21.15.16:0/3283635180 learned_addr learned my addr 172.21.15.16:0/3283635180 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4dffff640 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5124ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d5143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 -- 172.21.15.16:0/3283635180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 msgr2=0x55d6d5143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d5143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 -- 172.21.15.16:0/3283635180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 msgr2=0x55d6d5124ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5124ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 -- 172.21.15.16:0/3283635180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d513a250 con 0x55d6d4d408e0 2024-09-21T00:46:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009600 tx=0x7fa4d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c1efcdb3c88120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4ddffb640 1 -- 172.21.15.16:0/3283635180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8021070 con 0x55d6d4d408e0 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4ddffb640 1 -- 172.21.15.16:0/3283635180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8016d70 con 0x55d6d4d408e0 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.325+0000 7fa4ddffb640 1 -- 172.21.15.16:0/3283635180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80245c0 con 0x55d6d4d408e0 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- 172.21.15.16:0/3283635180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 msgr2=0x55d6d5125c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009600 tx=0x7fa4d8008040 comp rx=0 tx=0).stop 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- 172.21.15.16:0/3283635180 shutdown_connections 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d5143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d5124ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/3283635180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d5125c70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- 172.21.15.16:0/3283635180 >> 172.21.15.16:0/3283635180 conn(0x55d6d4d76350 msgr2=0x55d6d51243b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- 172.21.15.16:0/3283635180 shutdown_connections 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- 172.21.15.16:0/3283635180 wait complete. 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.326+0000 7fa4f47e1740 1 -- start start 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 Processor -- start 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d514bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d514c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5149cc0 con 0x55d6d4d408e0 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6d51495f0 con 0x55d6d4d590a0 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6d514a390 con 0x55d6d4d61280 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4f47e1740 10 client.0 _ll_register_callbacks cb 0x7fa4d00f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53010/0 (socket says 172.21.15.16:53010) 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d514bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4e7fff640 1 -- 172.21.15.16:0/4054513466 learned_addr learned my addr 172.21.15.16:0/4054513466 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.327+0000 7fa4ec80a640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d514c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 -- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 msgr2=0x55d6d514c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d514c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 -- 172.21.15.16:0/4054513466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 msgr2=0x55d6d514bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d514bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 -- 172.21.15.16:0/4054513466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d514ccb0 con 0x55d6d4d408e0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4dffff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d514bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4e7fff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8015ee0 tx=0x7fa4d80155d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bc4877bf85255f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8021040 con 0x55d6d4d408e0 2024-09-21T00:46:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa4d8026450 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d8016d70 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4d8026670 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4f47e1740 10 client.15348 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d6d51b5370 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.328+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4d8016d70 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d80308a0 con 0x55d6d4d408e0 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 10 client.15348 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 10 client.15348 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 20 client.15348 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d81f60 0x55d6d51b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 4 client.15348 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "status"}) -- 0x55d6d509d610 con 0x55d6d4d81f60 2024-09-21T00:46:06.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.329+0000 7fa4dffff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d81f60 0x55d6d51b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4c77fe640 10 client.15348 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:46:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4dffff640 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d81f60 0x55d6d51b88b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9df140261bce2aa server_cookie=bb1e5b491f7fcce0 in_seq=0 out_seq=0 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4c77fe640 1 -- 172.21.15.16:0/4054513466 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d6d509d610 con 0x55d6d4d81f60 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4c77fe640 10 client.15348 handle_command_reply: tid=0 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 client.15348 shutdown 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 msgr2=0x55d6d51529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8015ee0 tx=0x7fa4d80155d0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 shutdown_connections 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6d4d61280 0x55d6d514c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6d4d590a0 0x55d6d514bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55d6d4d81f60 0x55d6d51b88b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4c77fe640 0 client.15348 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 --2- 172.21.15.16:0/4054513466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d6d4d408e0 0x55d6d51529d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.330+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 >> 172.21.15.16:0/4054513466 conn(0x55d6d4d76350 msgr2=0x55d6d5128f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 shutdown_connections 2024-09-21T00:46:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4f47e1740 1 -- 172.21.15.16:0/4054513466 wait complete. 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4f47e1740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24625, 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 98.600167232000004, 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:46:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:46:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:46:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 128.36063146399999 2024-09-21T00:46:06.337 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 msgr2=0x7fa4d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 0x7fa4d40b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00094e0 tx=0x7fa4e002f3a0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 msgr2=0x7fa4e819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c970 tx=0x7fa4d000cd70 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 shutdown_connections 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa4d40b6510 0x7fa4d40b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4e810de90 0x7fa4e819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4e8105380 0x7fa4e819aae0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 --2- 172.21.15.16:0/1937195271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e8104a30 0x7fa4e819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.331+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 >> 172.21.15.16:0/1937195271 conn(0x7fa4e8079770 msgr2=0x7fa4e8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.332+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 shutdown_connections 2024-09-21T00:46:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:06.332+0000 7fa4ee26d640 1 -- 172.21.15.16:0/1937195271 wait complete. 2024-09-21T00:46:07.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T00:46:07.328 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:07.600 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:07 smithi016 ceph-mon[30947]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:46:07.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:07 smithi123 ceph-mon[34853]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:46:07.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:07 smithi178 ceph-mon[34888]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T00:46:07.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 -- 172.21.15.16:0/1792997707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 msgr2=0x7ff5341125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 --2- 172.21.15.16:0/1792997707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341125c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009900 tx=0x7ff52c02a3f0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 -- 172.21.15.16:0/1792997707 shutdown_connections 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 --2- 172.21.15.16:0/1792997707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341125c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 --2- 172.21.15.16:0/1792997707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 0x7ff53410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 --2- 172.21.15.16:0/1792997707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 0x7ff534075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 -- 172.21.15.16:0/1792997707 >> 172.21.15.16:0/1792997707 conn(0x7ff53407b910 msgr2=0x7ff53407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 -- 172.21.15.16:0/1792997707 shutdown_connections 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.828+0000 7ff53b377640 1 -- 172.21.15.16:0/1792997707 wait complete. 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 Processor -- start 2024-09-21T00:46:07.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 -- start start 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 0x7ff53419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 0x7ff53419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff534115c90 con 0x7ff5341101a0 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff534115b10 con 0x7ff534076080 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff53b377640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff534115e10 con 0x7ff534075730 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53022/0 (socket says 172.21.15.16:53022) 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 -- 172.21.15.16:0/3106211232 learned_addr learned my addr 172.21.15.16:0/3106211232 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff538912640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 0x7ff53419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539113640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 0x7ff53419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 -- 172.21.15.16:0/3106211232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 msgr2=0x7ff53419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 0x7ff53419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 -- 172.21.15.16:0/3106211232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 msgr2=0x7ff53419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 0x7ff53419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.829+0000 7ff539914640 1 -- 172.21.15.16:0/3106211232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341a2490 con 0x7ff5341101a0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff539914640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff52c004770 tx=0x7ff52c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff5267fc640 1 -- 172.21.15.16:0/3106211232 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c03f030 con 0x7ff5341101a0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff5267fc640 1 -- 172.21.15.16:0/3106211232 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c003aa0 con 0x7ff5341101a0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a2720 con 0x7ff5341101a0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff5267fc640 1 -- 172.21.15.16:0/3106211232 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c035070 con 0x7ff5341101a0 2024-09-21T00:46:07.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.830+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a2c00 con 0x7ff5341101a0 2024-09-21T00:46:07.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 Processor -- start 2024-09-21T00:46:07.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5267fc640 1 -- 172.21.15.16:0/3106211232 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff52c042030 con 0x7ff5341101a0 2024-09-21T00:46:07.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 -- start start 2024-09-21T00:46:07.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec74f60 0x55aa4f01af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec54280 0x55aa4f01b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ef92c10 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ef82040 con 0x55aa4ec74f60 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff5418eb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ef85e50 con 0x55aa4ec54280 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.833+0000 7ff539113640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53034/0 (socket says 172.21.15.16:53034) 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 -- 172.21.15.16:0/1774070069 learned_addr learned my addr 172.21.15.16:0/1774070069 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff538912640 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec74f60 0x55aa4f01af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff538912640 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec54280 0x55aa4f01b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 -- 172.21.15.16:0/1774070069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec54280 msgr2=0x55aa4f01b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec54280 0x55aa4f01b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 -- 172.21.15.16:0/1774070069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec74f60 msgr2=0x55aa4f01af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff5267fc640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 0x7ff5200b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec74f60 0x55aa4f01af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 -- 172.21.15.16:0/1774070069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ece0540 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff538912640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 0x7ff5200b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff5267fc640 1 -- 172.21.15.16:0/3106211232 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7ff52c1077d0 con 0x7ff5341101a0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff539113640 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff530007ed0 tx=0x7ff53000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab29f3e671f230e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff51f7fe640 1 -- 172.21.15.16:0/1774070069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530014070 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff51f7fe640 1 -- 172.21.15.16:0/1774070069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff530004d20 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.834+0000 7ff51f7fe640 1 -- 172.21.15.16:0/1774070069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530005440 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 -- 172.21.15.16:0/1774070069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 msgr2=0x55aa4f01b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff538912640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 0x7ff5200b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff528005d00 tx=0x7ff5280046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff530007ed0 tx=0x7ff53000e720 comp rx=0 tx=0).stop 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 -- 172.21.15.16:0/1774070069 shutdown_connections 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec54280 0x55aa4f01b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f01b440 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1774070069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec74f60 0x55aa4f01af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 -- 172.21.15.16:0/1774070069 >> 172.21.15.16:0/1774070069 conn(0x55aa4ec69350 msgr2=0x55aa4f018df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.835+0000 7ff5418eb740 1 -- 172.21.15.16:0/1774070069 shutdown_connections 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.836+0000 7ff5418eb740 1 -- 172.21.15.16:0/1774070069 wait complete. 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.836+0000 7ff5418eb740 1 -- start start 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.836+0000 7ff5418eb740 1 Processor -- start 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.836+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f026da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ede35f0 con 0x55aa4ec74f60 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ef1d010 con 0x55aa4ec54280 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f0296e0 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 10 client.0 _ll_register_callbacks cb 0x55aa4ef7c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53046/0 (socket says 172.21.15.16:53046) 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 -- 172.21.15.16:0/3231609239 learned_addr learned my addr 172.21.15.16:0/3231609239 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:07.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539113640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff538912640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f026da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 -- 172.21.15.16:0/3231609239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 msgr2=0x55aa4f0267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 -- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 msgr2=0x55aa4f026da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f026da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 -- 172.21.15.16:0/3231609239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4ef4aa00 con 0x55aa4ec74f60 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff539914640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff52c031440 tx=0x7ff52c0c9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732db6dfafccf97e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff51cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c049040 con 0x55aa4ec74f60 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7ff52c0035f0 con 0x55aa4ec74f60 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.837+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff530004d20 con 0x55aa4ec74f60 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff52c0c9160 con 0x55aa4ec74f60 2024-09-21T00:46:07.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 10 client.15360 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa4f035600 con 0x55aa4ec74f60 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c0b6070 con 0x55aa4ec74f60 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff52c03bb10 con 0x55aa4ec74f60 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 10 client.15360 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 10 client.15360 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 20 client.15360 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec338e0 0x55aa4f039150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 4 client.15360 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa4ef94b60 con 0x55aa4ec338e0 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.838+0000 7ff539113640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec338e0 0x55aa4f039150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.839+0000 7ff51cff9640 10 client.15360 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:46:07.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.839+0000 7ff539113640 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec338e0 0x55aa4f039150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1467e3d40f9daddd server_cookie=da8496310332f47 in_seq=0 out_seq=0 2024-09-21T00:46:07.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff51cff9640 1 -- 172.21.15.16:0/3231609239 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa4ef94b60 con 0x55aa4ec338e0 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff51cff9640 10 client.15360 handle_command_reply: tid=0 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 client.15360 shutdown 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 msgr2=0x55aa4f032a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff52c031440 tx=0x7ff52c0c9950 comp rx=0 tx=0).stop 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 shutdown_connections 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec338e0 0x55aa4f039150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f032a30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f026da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3231609239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 >> 172.21.15.16:0/3231609239 conn(0x55aa4ec69350 msgr2=0x55aa4f01e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff51cff9640 0 client.15360 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 shutdown_connections 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 1 -- 172.21.15.16:0/3231609239 wait complete. 2024-09-21T00:46:07.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.840+0000 7ff5418eb740 20 client.15360 trim_cache size 0 max 16384 2024-09-21T00:46:07.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.858+0000 7ff5418eb740 1 Processor -- start 2024-09-21T00:46:07.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.858+0000 7ff5418eb740 1 -- start start 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0329a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 0x55aa4f026730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f037490 con 0x55aa4ec54280 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f037b60 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff5418eb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f038230 con 0x55aa4ec74f60 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53052/0 (socket says 172.21.15.16:53052) 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 -- 172.21.15.16:0/3719077673 learned_addr learned my addr 172.21.15.16:0/3719077673 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:07.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff539113640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0329a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff539914640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 0x55aa4f026730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 -- 172.21.15.16:0/3719077673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 msgr2=0x55aa4f026730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 0x55aa4f026730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 -- 172.21.15.16:0/3719077673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 msgr2=0x55aa4f0329a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0329a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff538912640 1 -- 172.21.15.16:0/3719077673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4f013080 con 0x55aa4ec54280 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff539914640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 0x55aa4f026730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.859+0000 7ff539113640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0329a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.860+0000 7ff538912640 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff5280042e0 tx=0x7ff52800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fa3cadfb64fbbb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.860+0000 7ff51effd640 1 -- 172.21.15.16:0/3719077673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280043d0 con 0x55aa4ec54280 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.860+0000 7ff51effd640 1 -- 172.21.15.16:0/3719077673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52801f910 con 0x55aa4ec54280 2024-09-21T00:46:07.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.860+0000 7ff51effd640 1 -- 172.21.15.16:0/3719077673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528011960 con 0x55aa4ec54280 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 -- 172.21.15.16:0/3719077673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 msgr2=0x55aa4f032ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff5280042e0 tx=0x7ff52800b390 comp rx=0 tx=0).stop 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 -- 172.21.15.16:0/3719077673 shutdown_connections 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec74f60 0x55aa4f026730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec54280 0x55aa4f032ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 --2- 172.21.15.16:0/3719077673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f0329a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 -- 172.21.15.16:0/3719077673 >> 172.21.15.16:0/3719077673 conn(0x55aa4ec69350 msgr2=0x55aa4f0219a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 -- 172.21.15.16:0/3719077673 shutdown_connections 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.861+0000 7ff5418eb740 1 -- 172.21.15.16:0/3719077673 wait complete. 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 -- start start 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 Processor -- start 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f041a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f03aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f038fd0 con 0x55aa4ec74f60 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f038900 con 0x55aa4ec54280 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55aa4f0396a0 con 0x55aa4ec4c0a0 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.862+0000 7ff5418eb740 10 client.0 _ll_register_callbacks cb 0x7ff52c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:07.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53054/0 (socket says 172.21.15.16:53054) 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 -- 172.21.15.16:0/1514081705 learned_addr learned my addr 172.21.15.16:0/1514081705 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539113640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f041a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff538912640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f03aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 -- 172.21.15.16:0/1514081705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 msgr2=0x55aa4f041a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f041a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 -- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 msgr2=0x55aa4f03aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f03aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 -- 172.21.15.16:0/1514081705 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4f03b9c0 con 0x55aa4ec74f60 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff539914640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff52c03bf50 tx=0x7ff52c0d23c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f77f8dcbd3a0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff51cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c049030 con 0x55aa4ec74f60 2024-09-21T00:46:07.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7ff52c0e3ba0 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.863+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff52801f910 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff52c0d7460 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 10 client.15366 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa4f041330 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52801f910 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff52c0c9340 con 0x55aa4ec74f60 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 10 client.15366 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 10 client.15366 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 20 client.15366 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec08c90 0x55aa4f0a7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 4 client.15366 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "status"}) -- 0x55aa4ef90610 con 0x55aa4ec08c90 2024-09-21T00:46:07.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.864+0000 7ff539113640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec08c90 0x55aa4f0a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff51cff9640 10 client.15366 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff539113640 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec08c90 0x55aa4f0a7970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48fce85003fd6897 server_cookie=75675f68d5b61006 in_seq=0 out_seq=0 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff51cff9640 1 -- 172.21.15.16:0/1514081705 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55aa4ef90610 con 0x55aa4ec08c90 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff51cff9640 10 client.15366 handle_command_reply: tid=0 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 client.15366 shutdown 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 msgr2=0x55aa4f03b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff52c03bf50 tx=0x7ff52c0d23c0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 shutdown_connections 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55aa4ec08c90 0x55aa4f0a7970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55aa4ec74f60 0x55aa4f03b400 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff51cff9640 0 client.15366 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:46:07.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa4ec54280 0x55aa4f03aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 --2- 172.21.15.16:0/1514081705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aa4ec4c0a0 0x55aa4f041a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.865+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 >> 172.21.15.16:0/1514081705 conn(0x55aa4ec69350 msgr2=0x55aa4f026730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 shutdown_connections 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff5418eb740 1 -- 172.21.15.16:0/1514081705 wait complete. 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff5418eb740 20 client.15366 trim_cache size 0 max 16384 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24644, 2024-09-21T00:46:07.871 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 101.141519726, 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 132.469435903 2024-09-21T00:46:07.872 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 msgr2=0x7ff5200b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 0x7ff5200b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff528005d00 tx=0x7ff5280046c0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 msgr2=0x7ff5341a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff52c004770 tx=0x7ff52c004270 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 shutdown_connections 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7ff5200b6540 0x7ff5200b8a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5341101a0 0x7ff5341a1e20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff534076080 0x7ff53419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 --2- 172.21.15.16:0/3106211232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534075730 0x7ff53419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 >> 172.21.15.16:0/3106211232 conn(0x7ff53407b910 msgr2=0x7ff534109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:07.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.866+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 shutdown_connections 2024-09-21T00:46:07.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:07.867+0000 7ff53b377640 1 -- 172.21.15.16:0/3106211232 wait complete. 2024-09-21T00:46:08.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:46:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 -- 172.21.15.16:0/4154070879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25541094a0 msgr2=0x7f25541098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 --2- 172.21.15.16:0/4154070879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25541094a0 0x7f25541098b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f253c009900 tx=0x7f253c02a410 comp rx=0 tx=0).stop 2024-09-21T00:46:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 -- 172.21.15.16:0/4154070879 shutdown_connections 2024-09-21T00:46:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 --2- 172.21.15.16:0/4154070879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 0x7f2554110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 --2- 172.21.15.16:0/4154070879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25541094a0 0x7f25541098b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 --2- 172.21.15.16:0/4154070879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2554103b60 0x7f2554103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 -- 172.21.15.16:0/4154070879 >> 172.21.15.16:0/4154070879 conn(0x7f255407b850 msgr2=0x7f255407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 -- 172.21.15.16:0/4154070879 shutdown_connections 2024-09-21T00:46:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.473+0000 7f255a48e640 1 -- 172.21.15.16:0/4154070879 wait complete. 2024-09-21T00:46:09.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 Processor -- start 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 -- start start 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25541094a0 0x7f255419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 0x7f255419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113ab0 con 0x7f2554103b60 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113930 con 0x7f25541094a0 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f255a48e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113c30 con 0x7f2554109df0 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f2553fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f2553fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53080/0 (socket says 172.21.15.16:53080) 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f2553fff640 1 -- 172.21.15.16:0/1842787370 learned_addr learned my addr 172.21.15.16:0/1842787370 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f254bfff640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25541094a0 0x7f255419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.474+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 0x7f255419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 -- 172.21.15.16:0/1842787370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 msgr2=0x7f255419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 0x7f255419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 -- 172.21.15.16:0/1842787370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25541094a0 msgr2=0x7f255419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25541094a0 0x7f255419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 -- 172.21.15.16:0/1842787370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541a0410 con 0x7f2554103b60 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2553fff640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f254400d950 tx=0x7f254400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2551ffb640 1 -- 172.21.15.16:0/1842787370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544017070 con 0x7f2554103b60 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541a0700 con 0x7f2554103b60 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2551ffb640 1 -- 172.21.15.16:0/1842787370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544009c30 con 0x7f2554103b60 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f2551ffb640 1 -- 172.21.15.16:0/1842787370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254400f620 con 0x7f2554103b60 2024-09-21T00:46:09.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.475+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a6e60 con 0x7f2554103b60 2024-09-21T00:46:09.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 Processor -- start 2024-09-21T00:46:09.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 -- start start 2024-09-21T00:46:09.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2551ffb640 1 -- 172.21.15.16:0/1842787370 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2544010460 con 0x7f2554103b60 2024-09-21T00:46:09.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e96966f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96967440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e968dec10 con 0x561e965a0280 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561e968ce040 con 0x561e965c0f60 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2560a02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561e968d1e50 con 0x561e965980a0 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f254bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f254bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53086/0 (socket says 172.21.15.16:53086) 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f254bfff640 1 -- 172.21.15.16:0/865353714 learned_addr learned my addr 172.21.15.16:0/865353714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2553fff640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96967440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.478+0000 7f2558a2b640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e96966f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 -- 172.21.15.16:0/865353714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 msgr2=0x561e96967440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96967440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 -- 172.21.15.16:0/865353714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 msgr2=0x561e96966f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e96966f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 -- 172.21.15.16:0/865353714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9662c540 con 0x561e965a0280 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f2558a2b640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e96966f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254bfff640 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f253c009900 tx=0x7f253c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fd94259e1d6224 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f2551ffb640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 0x7f25400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254a7fc640 1 -- 172.21.15.16:0/865353714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c040070 con 0x561e965a0280 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254a7fc640 1 -- 172.21.15.16:0/865353714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c004030 con 0x561e965a0280 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 0x7f25400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f254a7fc640 1 -- 172.21.15.16:0/865353714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c035040 con 0x561e965a0280 2024-09-21T00:46:09.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.479+0000 7f2551ffb640 1 -- 172.21.15.16:0/1842787370 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f25440e6ea0 con 0x7f2554103b60 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- 172.21.15.16:0/865353714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 msgr2=0x561e96967980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 0x7f25400b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f254c005fd0 tx=0x7f254c009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f253c009900 tx=0x7f253c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- 172.21.15.16:0/865353714 shutdown_connections 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96967980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96967440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 --2- 172.21.15.16:0/865353714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e96966f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- 172.21.15.16:0/865353714 >> 172.21.15.16:0/865353714 conn(0x561e965b5350 msgr2=0x561e96964df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- 172.21.15.16:0/865353714 shutdown_connections 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- 172.21.15.16:0/865353714 wait complete. 2024-09-21T00:46:09.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.480+0000 7f2560a02740 1 -- start start 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 Processor -- start 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96972a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e9697e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e9672f5f0 con 0x561e965a0280 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561e96869010 con 0x561e965c0f60 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561e96975680 con 0x561e965980a0 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2560a02740 10 client.0 _ll_register_callbacks cb 0x561e968c8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f254bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f254bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53094/0 (socket says 172.21.15.16:53094) 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f254bfff640 1 -- 172.21.15.16:0/2938676736 learned_addr learned my addr 172.21.15.16:0/2938676736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2558a2b640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e9697e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.481+0000 7f2553fff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96972a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 -- 172.21.15.16:0/2938676736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 msgr2=0x561e96972a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96972a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 -- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 msgr2=0x561e9697e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e9697e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 -- 172.21.15.16:0/2938676736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e96896a00 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f254bfff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f253c005ee0 tx=0x7f253c0041e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284209d56e2089d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f25337fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c040070 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f253c005460 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c004030 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f253c035040 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f2560a02740 10 client.15378 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561e96981610 con 0x561e965a0280 2024-09-21T00:46:09.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.482+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c004030 con 0x561e965a0280 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f253c004d50 con 0x561e965a0280 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 10 client.15378 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 20 client.15378 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e9657f8e0 0x561e96984ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 4 client.15378 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e968e0b60 con 0x561e9657f8e0 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2553fff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e9657f8e0 0x561e96984ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f25337fe640 10 client.15378 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.483+0000 7f2553fff640 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e9657f8e0 0x561e96984ba0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397d646bc8a4937 server_cookie=aefb3d4324fbbf0b in_seq=0 out_seq=0 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f25337fe640 1 -- 172.21.15.16:0/2938676736 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e968e0b60 con 0x561e9657f8e0 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f25337fe640 10 client.15378 handle_command_reply: tid=0 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f2560a02740 1 client.15378 shutdown 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 msgr2=0x561e96972f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f253c005ee0 tx=0x7f253c0041e0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 shutdown_connections 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.484+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e9657f8e0 0x561e96984ba0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f25337fe640 0 client.15378 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965c0f60 0x561e9697e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96972f40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 --2- 172.21.15.16:0/2938676736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e96972a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 >> 172.21.15.16:0/2938676736 conn(0x561e965b5350 msgr2=0x561e9696a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 shutdown_connections 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 1 -- 172.21.15.16:0/2938676736 wait complete. 2024-09-21T00:46:09.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.485+0000 7f2560a02740 20 client.15378 trim_cache size 0 max 16384 2024-09-21T00:46:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 Processor -- start 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 -- start start 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e9657f8e0 0x561e96983730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e9695fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e96982ee0 con 0x561e965a0280 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561e969835b0 con 0x561e9657f8e0 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2560a02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561e96983c80 con 0x561e965980a0 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2558a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2558a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53106/0 (socket says 172.21.15.16:53106) 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2558a2b640 1 -- 172.21.15.16:0/1429177501 learned_addr learned my addr 172.21.15.16:0/1429177501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.503+0000 7f2553fff640 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e9657f8e0 0x561e96983730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f254bfff640 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e9695fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 -- 172.21.15.16:0/1429177501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 msgr2=0x561e9695fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e9695fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 -- 172.21.15.16:0/1429177501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e9657f8e0 msgr2=0x561e96983730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e9657f8e0 0x561e96983730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 -- 172.21.15.16:0/1429177501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9696e090 con 0x561e965a0280 2024-09-21T00:46:09.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2558a2b640 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f254c010790 tx=0x7f254c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83b3fc5b2c5dd77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2549ffb640 1 -- 172.21.15.16:0/1429177501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c01c7c0 con 0x561e965a0280 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2549ffb640 1 -- 172.21.15.16:0/1429177501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c01ce10 con 0x561e965a0280 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.504+0000 7f2549ffb640 1 -- 172.21.15.16:0/1429177501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c01b390 con 0x561e965a0280 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- 172.21.15.16:0/1429177501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 msgr2=0x561e96964d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f254c010790 tx=0x7f254c019000 comp rx=0 tx=0).stop 2024-09-21T00:46:09.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- 172.21.15.16:0/1429177501 shutdown_connections 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96964d10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e965980a0 0x561e9695fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 --2- 172.21.15.16:0/1429177501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e9657f8e0 0x561e96983730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- 172.21.15.16:0/1429177501 >> 172.21.15.16:0/1429177501 conn(0x561e965b5350 msgr2=0x561e96964600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- 172.21.15.16:0/1429177501 shutdown_connections 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- 172.21.15.16:0/1429177501 wait complete. 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.505+0000 7f2560a02740 1 -- start start 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 Processor -- start 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e9657f8e0 0x561e9698d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 0x561e96986bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e96984a20 con 0x561e965a0280 2024-09-21T00:46:09.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561e96984350 con 0x561e965980a0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561e969850f0 con 0x561e9657f8e0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2560a02740 10 client.0 _ll_register_callbacks cb 0x7f25440ea7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53120/0 (socket says 172.21.15.16:53120) 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 -- 172.21.15.16:0/727934279 learned_addr learned my addr 172.21.15.16:0/727934279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2553fff640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e9657f8e0 0x561e9698d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f254bfff640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 0x561e96986bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 -- 172.21.15.16:0/727934279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e9657f8e0 msgr2=0x561e9698d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e9657f8e0 0x561e9698d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 -- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 msgr2=0x561e96986bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 0x561e96986bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f2558a2b640 1 -- 172.21.15.16:0/727934279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e96987980 con 0x561e965a0280 2024-09-21T00:46:09.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.506+0000 7f254bfff640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 0x561e96986bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2558a2b640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f254c028fd0 tx=0x7f254c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f332f625e0b46495 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c037060 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f254c028840 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254c01ce10 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f254c01c5c0 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 10 client.15384 fetch_fsmap learned FSMap version 27 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561e969f00d0 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c01ce10 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f254c027070 con 0x561e965a0280 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 10 client.15384 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 10 client.15384 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 20 client.15384 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:09.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e965c0f60 0x561e969f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 4 client.15384 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.507+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "status"}) -- 0x561e968dc610 con 0x561e965c0f60 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.508+0000 7f2553fff640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e965c0f60 0x561e969f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.508+0000 7f2553fff640 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e965c0f60 0x561e969f35f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4e1871891554ce6 server_cookie=d21b2a9aa2aac82a in_seq=0 out_seq=0 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.508+0000 7f25337fe640 10 client.15384 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.508+0000 7f25337fe640 1 -- 172.21.15.16:0/727934279 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x561e968dc610 con 0x561e965c0f60 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f25337fe640 10 client.15384 handle_command_reply: tid=0 2024-09-21T00:46:09.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 client.15384 shutdown 2024-09-21T00:46:09.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 msgr2=0x561e96987210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f254c028fd0 tx=0x7f254c004ac0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 shutdown_connections 2024-09-21T00:46:09.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x561e965c0f60 0x561e969f35f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e965a0280 0x561e96987210 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561e965980a0 0x561e96986bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 --2- 172.21.15.16:0/727934279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e9657f8e0 0x561e9698d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f25337fe640 0 client.15384 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 >> 172.21.15.16:0/727934279 conn(0x561e965b5350 msgr2=0x561e96967f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 shutdown_connections 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 1 -- 172.21.15.16:0/727934279 wait complete. 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f2560a02740 20 client.15384 trim_cache size 0 max 16384 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "49060640-77b1-11ef-baf5-efdc52797490", 2024-09-21T00:46:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24677, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 110.829767355, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 27, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 75, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 122.058100677 2024-09-21T00:46:09.516 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 msgr2=0x7f25400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.509+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 0x7f25400b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f254c005fd0 tx=0x7f254c009600 comp rx=0 tx=0).stop 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 msgr2=0x7f255419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f254400d950 tx=0x7f254400de10 comp rx=0 tx=0).stop 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 shutdown_connections 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25400b6510 0x7f25400b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2554109df0 0x7f255419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25541094a0 0x7f255419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 --2- 172.21.15.16:0/1842787370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2554103b60 0x7f255419a4a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:09.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 >> 172.21.15.16:0/1842787370 conn(0x7f255407b850 msgr2=0x7f2554105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:09.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 shutdown_connections 2024-09-21T00:46:09.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:09.510+0000 7f255a48e640 1 -- 172.21.15.16:0/1842787370 wait complete. 2024-09-21T00:46:09.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:09 smithi016 ceph-mon[30947]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:46:09.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:09 smithi123 ceph-mon[34853]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:46:09.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:09 smithi178 ceph-mon[34888]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T00:46:10.383 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T00:46:10.406 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T00:46:10.406 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T00:46:10.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:10.407 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-21T00:46:10.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:10.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-09-21T00:46:10.495 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-09-21T00:46:10.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:46:10.497 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T00:46:10.497 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:46:10.497 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:10.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T00:46:10.796 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:11.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 -- 172.21.15.16:0/770556398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8501083a0 msgr2=0x7fb8501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 --2- 172.21.15.16:0/770556398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8501083a0 0x7fb8501087b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb838009900 tx=0x7fb83802a410 comp rx=0 tx=0).stop 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 -- 172.21.15.16:0/770556398 shutdown_connections 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 --2- 172.21.15.16:0/770556398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb850108cf0 0x7fb85010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 --2- 172.21.15.16:0/770556398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8501083a0 0x7fb8501087b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 --2- 172.21.15.16:0/770556398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 0x7fb850102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 -- 172.21.15.16:0/770556398 >> 172.21.15.16:0/770556398 conn(0x7fb850079730 msgr2=0x7fb850079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 -- 172.21.15.16:0/770556398 shutdown_connections 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.279+0000 7fb85601b640 1 -- 172.21.15.16:0/770556398 wait complete. 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.280+0000 7fb85601b640 1 Processor -- start 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.280+0000 7fb85601b640 1 -- start start 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 0x7fb85019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 0x7fb85019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb850113aa0 con 0x7fb850108cf0 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb850113920 con 0x7fb8501083a0 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb850113c20 con 0x7fb850102a60 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53132/0 (socket says 172.21.15.16:53132) 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 -- 172.21.15.16:0/3869249599 learned_addr learned my addr 172.21.15.16:0/3869249599 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84f7fe640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 0x7fb85019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84effd640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 0x7fb85019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 -- 172.21.15.16:0/3869249599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 msgr2=0x7fb85019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 0x7fb85019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 -- 172.21.15.16:0/3869249599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 msgr2=0x7fb85019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 0x7fb85019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 -- 172.21.15.16:0/3869249599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8501a0380 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84effd640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 0x7fb85019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84ffff640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb84800cce0 tx=0x7fb84800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84800f450 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8501a0670 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.281+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84800faa0 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.282+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848018a80 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.282+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8501a6e90 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.283+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb850103ce0 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.284+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb84800fc50 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.285+0000 7fb84cff9640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 0x7fb83c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.285+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fb8480e7780 con 0x7fb850108cf0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.285+0000 7fb84f7fe640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 0x7fb83c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.285+0000 7fb84f7fe640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 0x7fb83c0b8a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb840009990 tx=0x7fb840009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.289+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb848014030 con 0x7fb850108cf0 2024-09-21T00:46:11.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:11 smithi016 ceph-mon[30947]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:46:11.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.520+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb85010ab40 con 0x7fb850108cf0 2024-09-21T00:46:11.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.521+0000 7fb84cff9640 1 -- 172.21.15.16:0/3869249599 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fb8480ae000 con 0x7fb850108cf0 2024-09-21T00:46:11.522 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T00:46:11.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 msgr2=0x7fb83c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 0x7fb83c0b8a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb840009990 tx=0x7fb840009110 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 msgr2=0x7fb85019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb84800cce0 tx=0x7fb84800a620 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 shutdown_connections 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fb83c0b6540 0x7fb83c0b8a50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb850108cf0 0x7fb85019fd10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8501083a0 0x7fb85019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.523+0000 7fb85601b640 1 --2- 172.21.15.16:0/3869249599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb850102a60 0x7fb85019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.524+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 >> 172.21.15.16:0/3869249599 conn(0x7fb850079730 msgr2=0x7fb8501052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.524+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 shutdown_connections 2024-09-21T00:46:11.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:11.524+0000 7fb85601b640 1 -- 172.21.15.16:0/3869249599 wait complete. 2024-09-21T00:46:11.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:11 smithi123 ceph-mon[34853]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:46:11.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:11 smithi178 ceph-mon[34888]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:46:12.264 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:46:12.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:12.265 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:46:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42131sec preferred_lft 42131sec 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:46:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-09-21T00:46:12.285 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:46:12.286 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-21T00:46:12.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:12.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:12 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3869249599' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:46:12.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:12.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:12.508 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:46:12.534 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-09-21T00:46:12.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:12.535 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:46:12.614 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:46:12.615 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-21T00:46:12.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T00:46:12.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T00:46:12.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T00:46:12.615 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-21T00:46:12.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:12.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:12 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3869249599' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:46:12.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:12 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3869249599' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:46:12.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:12.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:12.901 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-21T00:46:12.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:12.918 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-09-21T00:46:12.973 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:46:12.974 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-21T00:46:12.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:46:12.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T00:46:12.974 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-21T00:46:13.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:13.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.094 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T00:46:13.094 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-21T00:46:13.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:13.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.224 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:46:13.224 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-21T00:46:13.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-09-21T00:46:13.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:46:13.224 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-21T00:46:13.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:46:13.303 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:13.319 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:46:13.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:46:13.319 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:13.375 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T00:46:13.376 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T00:46:13.376 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/21cdfe27-aa36-4337-9422-b337c667d3ed 2024-09-21T00:46:13.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:13.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/21cdfe27-aa36-4337-9422-b337c667d3ed /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T00:46:13.496 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T00:46:13.496 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T00:46:13.496 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-09-21T00:46:13.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:13 smithi016 ceph-mon[30947]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:46:13.629 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T00:46:13.629 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T00:46:13.630 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-09-21T00:46:13.630 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.123:3300,172.21.15.178:3300" 2024-09-21T00:46:13.630 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:3300,172.21.15.123:3300,172.21.15.178:3300:/volumes/qa/sv_1/21cdfe27-aa36-4337-9422-b337c667d3ed 2024-09-21T00:46:13.630 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=49060640-77b1-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T00:46:13.631 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T00:46:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:46:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:46:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:46:13.631 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:46:13.632 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:46:13.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:46:13.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:13.659 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:46:13.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:46:13.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.758 INFO:teuthology.orchestra.run.smithi016.stdout:client15393 2024-09-21T00:46:13.759 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:46:13.759 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:46:13.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:13 smithi123 ceph-mon[34853]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:46:13.775 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:46:13.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:13 smithi178 ceph-mon[34888]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T00:46:13.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:46:13.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.872 INFO:teuthology.orchestra.run.smithi016.stdout:client15393 2024-09-21T00:46:13.873 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:46:13.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:46:13.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:13.931 INFO:teuthology.orchestra.run.smithi016.stdout:client15393 2024-09-21T00:46:13.932 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/49060640-77b1-11ef-baf5-efdc52797490.client15393/status') 2024-09-21T00:46:13.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:46:13.992 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.15393 (3)192.168.0.1:0/3817540931 2024-09-21T00:46:13.992 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-09-21T00:46:13.993 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-09-21T00:46:13.993 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-09-21T00:46:13.993 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 2.4086e-05 s, 2.9 MB/s 2024-09-21T00:46:13.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:46:14.000 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T00:46:14.015 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T00:46:14.016 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:46:14.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T00:46:14.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 -- 172.21.15.16:0/3767900813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c1025a0 msgr2=0x7f551c102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:14.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 --2- 172.21.15.16:0/3767900813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c1025a0 0x7f551c102a10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5514009ca0 tx=0x7f551402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 -- 172.21.15.16:0/3767900813 shutdown_connections 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 --2- 172.21.15.16:0/3767900813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c103fc0 0x7f551c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 --2- 172.21.15.16:0/3767900813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 --2- 172.21.15.16:0/3767900813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c1025a0 0x7f551c102a10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 -- 172.21.15.16:0/3767900813 >> 172.21.15.16:0/3767900813 conn(0x7f551c0fdee0 msgr2=0x7f551c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 -- 172.21.15.16:0/3767900813 shutdown_connections 2024-09-21T00:46:14.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.129+0000 7f55217f9640 1 -- 172.21.15.16:0/3767900813 wait complete. 2024-09-21T00:46:14.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 Processor -- start 2024-09-21T00:46:14.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 -- start start 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c1025a0 0x7f551c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f551c10e1f0 con 0x7f551c103fc0 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f551c10e070 con 0x7f551c1025a0 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f55217f9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f551c10e370 con 0x7f551c103620 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38384/0 (socket says 172.21.15.16:38384) 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.130+0000 7f551b7fe640 1 -- 172.21.15.16:0/3304927253 learned_addr learned my addr 172.21.15.16:0/3304927253 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551affd640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c1025a0 0x7f551c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551a7fc640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:14.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 -- 172.21.15.16:0/3304927253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 msgr2=0x7f551c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 -- 172.21.15.16:0/3304927253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c1025a0 msgr2=0x7f551c199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c1025a0 0x7f551c199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 -- 172.21.15.16:0/3304927253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c19b990 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551a7fc640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f551b7fe640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f550c00e970 tx=0x7f550c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c00cd00 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f550c0108e0 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c19bc20 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c018800 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.131+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c1a2370 con 0x7f551c103fc0 2024-09-21T00:46:14.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.132+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c102a10 con 0x7f551c103fc0 2024-09-21T00:46:14.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.135+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f550c010a90 con 0x7f551c103fc0 2024-09-21T00:46:14.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.135+0000 7f5513fff640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 0x7f55080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:14.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.136+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f550c0e7b60 con 0x7f551c103fc0 2024-09-21T00:46:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.136+0000 7f551affd640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 0x7f55080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:14.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.136+0000 7f551affd640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 0x7f55080b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f55140094e0 tx=0x7f5514004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:14.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.139+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f550c0ae480 con 0x7f551c103fc0 2024-09-21T00:46:14.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:14.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f551c1a2760 con 0x7f551c103fc0 2024-09-21T00:46:15.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.362+0000 7f5513fff640 1 -- 172.21.15.16:0/3304927253 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f550c0b2860 con 0x7f551c103fc0 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 msgr2=0x7f55080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 0x7f55080b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f55140094e0 tx=0x7f5514004a40 comp rx=0 tx=0).stop 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 msgr2=0x7f551c19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f550c00e970 tx=0x7f550c00ee30 comp rx=0 tx=0).stop 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 shutdown_connections 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f55080b6510 0x7f55080b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f551c103fc0 0x7f551c19b170 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551c103620 0x7f551c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 --2- 172.21.15.16:0/3304927253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f551c1025a0 0x7f551c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 >> 172.21.15.16:0/3304927253 conn(0x7f551c0fdee0 msgr2=0x7f551c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:15.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 shutdown_connections 2024-09-21T00:46:15.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.366+0000 7f55217f9640 1 -- 172.21.15.16:0/3304927253 wait complete. 2024-09-21T00:46:15.382 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T00:46:15.397 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T00:46:15.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 -- 172.21.15.16:0/2413463821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103fa0 msgr2=0x7f940c10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 --2- 172.21.15.16:0/2413463821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103fa0 0x7f940c10a940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9404009ca0 tx=0x7f940402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 -- 172.21.15.16:0/2413463821 shutdown_connections 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 --2- 172.21.15.16:0/2413463821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103fa0 0x7f940c10a940 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 --2- 172.21.15.16:0/2413463821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c103600 0x7f940c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 --2- 172.21.15.16:0/2413463821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c102580 0x7f940c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 -- 172.21.15.16:0/2413463821 >> 172.21.15.16:0/2413463821 conn(0x7f940c0fdee0 msgr2=0x7f940c100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:15.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 -- 172.21.15.16:0/2413463821 shutdown_connections 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.539+0000 7f9413fa1640 1 -- 172.21.15.16:0/2413463821 wait complete. 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 Processor -- start 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 -- start start 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 0x7f940c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c103fa0 0x7f940c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f940c10e1e0 con 0x7f940c103600 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f940c10e060 con 0x7f940c103fa0 2024-09-21T00:46:15.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f9413fa1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f940c10e360 con 0x7f940c102580 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f941153c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f941153c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38406/0 (socket says 172.21.15.16:38406) 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.540+0000 7f941153c640 1 -- 172.21.15.16:0/3733789380 learned_addr learned my addr 172.21.15.16:0/3733789380 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941253e640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c103fa0 0x7f940c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9411d3d640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 0x7f940c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 -- 172.21.15.16:0/3733789380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 msgr2=0x7f940c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 0x7f940c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 -- 172.21.15.16:0/3733789380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c103fa0 msgr2=0x7f940c199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c103fa0 0x7f940c199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 -- 172.21.15.16:0/3733789380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c19a7e0 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9411d3d640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 0x7f940c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f941153c640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009860 tx=0x7f93fc009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc005020 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93fc0047a0 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c19aad0 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc007b00 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.541+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c06bb30 con 0x7f940c103600 2024-09-21T00:46:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.542+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c19ad30 con 0x7f940c103600 2024-09-21T00:46:15.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.545+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f93fc004950 con 0x7f940c103600 2024-09-21T00:46:15.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.545+0000 7f9402ffd640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 0x7f93f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.546+0000 7f9411d3d640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 0x7f93f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.546+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f93fc0e9010 con 0x7f940c103600 2024-09-21T00:46:15.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.546+0000 7f9411d3d640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 0x7f93f80b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9408009b40 tx=0x7f9408005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:15.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.549+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93fc0af930 con 0x7f940c103600 2024-09-21T00:46:15.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.741+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f940c1091d0 con 0x7f940c103600 2024-09-21T00:46:15.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.742+0000 7f9402ffd640 1 -- 172.21.15.16:0/3733789380 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f93fc0b3d10 con 0x7f940c103600 2024-09-21T00:46:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:15.744 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:46:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 msgr2=0x7f93f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 0x7f93f80b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9408009b40 tx=0x7f9408005e50 comp rx=0 tx=0).stop 2024-09-21T00:46:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 msgr2=0x7f940c199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009860 tx=0x7f93fc009d20 comp rx=0 tx=0).stop 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 shutdown_connections 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f93f80b6510 0x7f93f80b8a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f940c103fa0 0x7f940c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f940c103600 0x7f940c199410 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 --2- 172.21.15.16:0/3733789380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940c102580 0x7f940c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 >> 172.21.15.16:0/3733789380 conn(0x7f940c0fdee0 msgr2=0x7f940c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 shutdown_connections 2024-09-21T00:46:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.745+0000 7f9413fa1640 1 -- 172.21.15.16:0/3733789380 wait complete. 2024-09-21T00:46:15.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:15 smithi016 ceph-mon[30947]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:15.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:15 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T00:46:15.758 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:39:36.636978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:44:14.364094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:44:16.243088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:46:15.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T00:46:15.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:15 smithi123 ceph-mon[34853]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:15.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:15 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T00:46:15.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:15 smithi178 ceph-mon[34888]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T00:46:15.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:15 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T00:46:15.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 -- 172.21.15.16:0/3843007957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103620 msgr2=0x7f54e0103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 --2- 172.21.15.16:0/3843007957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103620 0x7f54e0103a30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009900 tx=0x7f54d402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 -- 172.21.15.16:0/3843007957 shutdown_connections 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 --2- 172.21.15.16:0/3843007957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e0103fc0 0x7f54e010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 --2- 172.21.15.16:0/3843007957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103620 0x7f54e0103a30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 --2- 172.21.15.16:0/3843007957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e01025a0 0x7f54e0102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 -- 172.21.15.16:0/3843007957 >> 172.21.15.16:0/3843007957 conn(0x7f54e00fdee0 msgr2=0x7f54e0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 -- 172.21.15.16:0/3843007957 shutdown_connections 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.878+0000 7f54e4dad640 1 -- 172.21.15.16:0/3843007957 wait complete. 2024-09-21T00:46:15.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 Processor -- start 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 -- start start 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e01025a0 0x7f54e006c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e0103620 0x7f54e019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f54e010e200 con 0x7f54e0103fc0 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54e010e080 con 0x7f54e0103620 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54e4dad640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f54e010e380 con 0x7f54e01025a0 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38416/0 (socket says 172.21.15.16:38416) 2024-09-21T00:46:15.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 -- 172.21.15.16:0/1126656066 learned_addr learned my addr 172.21.15.16:0/1126656066 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54de59c640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e01025a0 0x7f54e006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ddd9b640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e0103620 0x7f54e019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 -- 172.21.15.16:0/1126656066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e01025a0 msgr2=0x7f54e006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e01025a0 0x7f54e006c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 -- 172.21.15.16:0/1126656066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e0103620 msgr2=0x7f54e019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e0103620 0x7f54e019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.879+0000 7f54ded9d640 1 -- 172.21.15.16:0/1126656066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e01a1a40 con 0x7f54e0103fc0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54ded9d640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f54d800eb10 tx=0x7f54d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8004b20 con 0x7f54e0103fc0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d8004cc0 con 0x7f54e0103fc0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e01a1d30 con 0x7f54e0103fc0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8010670 con 0x7f54e0103fc0 2024-09-21T00:46:15.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.880+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e01a21d0 con 0x7f54e0103fc0 2024-09-21T00:46:15.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.881+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e0109750 con 0x7f54e0103fc0 2024-09-21T00:46:15.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.883+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f54d8005000 con 0x7f54e0103fc0 2024-09-21T00:46:15.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.883+0000 7f54cf7fe640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 0x7f54c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:15.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.883+0000 7f54de59c640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 0x7f54c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:15.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.883+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f54d80e7b00 con 0x7f54e0103fc0 2024-09-21T00:46:15.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.884+0000 7f54de59c640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 0x7f54c80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009b60 tx=0x7f54d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:15.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:15.887+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54d8056710 con 0x7f54e0103fc0 2024-09-21T00:46:16.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.074+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f54e0063ff0 con 0x7f54e0103fc0 2024-09-21T00:46:16.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.075+0000 7f54cf7fe640 1 -- 172.21.15.16:0/1126656066 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f54d80ae420 con 0x7f54e0103fc0 2024-09-21T00:46:16.076 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 msgr2=0x7f54c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 0x7f54c80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009b60 tx=0x7f54d0005f90 comp rx=0 tx=0).stop 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 msgr2=0x7f54e01a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f54d800eb10 tx=0x7f54d800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 shutdown_connections 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54c80b6510 0x7f54c80b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0103fc0 0x7f54e01a1220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e0103620 0x7f54e019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 --2- 172.21.15.16:0/1126656066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54e01025a0 0x7f54e006c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 >> 172.21.15.16:0/1126656066 conn(0x7f54e00fdee0 msgr2=0x7f54e0106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 shutdown_connections 2024-09-21T00:46:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.077+0000 7f54e4dad640 1 -- 172.21.15.16:0/1126656066 wait complete. 2024-09-21T00:46:16.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T00:46:16.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 -- 172.21.15.16:0/3609796518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc41025a0 msgr2=0x7fbcc4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3609796518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc41025a0 0x7fbcc4102a10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 -- 172.21.15.16:0/3609796518 shutdown_connections 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3609796518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3609796518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc4103620 0x7fbcc4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3609796518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc41025a0 0x7fbcc4102a10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 -- 172.21.15.16:0/3609796518 >> 172.21.15.16:0/3609796518 conn(0x7fbcc40fdee0 msgr2=0x7fbcc4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 -- 172.21.15.16:0/3609796518 shutdown_connections 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.208+0000 7fbccb0de640 1 -- 172.21.15.16:0/3609796518 wait complete. 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 Processor -- start 2024-09-21T00:46:16.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 -- start start 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc41025a0 0x7fbcc4198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc410e1f0 con 0x7fbcc4103620 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc410e070 con 0x7fbcc41025a0 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbccb0de640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc410e370 con 0x7fbcc4103fc0 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38440/0 (socket says 172.21.15.16:38440) 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.209+0000 7fbcc3fff640 1 -- 172.21.15.16:0/3271517875 learned_addr learned my addr 172.21.15.16:0/3271517875 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc967b640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc8e7a640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc41025a0 0x7fbcc4198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 -- 172.21.15.16:0/3271517875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 msgr2=0x7fbcc419a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc419a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 -- 172.21.15.16:0/3271517875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc41025a0 msgr2=0x7fbcc4198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc41025a0 0x7fbcc4198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 -- 172.21.15.16:0/3271517875 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc419a860 con 0x7fbcc4103620 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc967b640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc3fff640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00d950 tx=0x7fbcac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac017070 con 0x7fbcc4103620 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc419ab50 con 0x7fbcc4103620 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcac009c30 con 0x7fbcc4103620 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00f620 con 0x7fbcc4103620 2024-09-21T00:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.210+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc41a1240 con 0x7fbcc4103620 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.211+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc4109770 con 0x7fbcc4103620 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.213+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbcac010460 con 0x7fbcc4103620 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.214+0000 7fbcc1ffb640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 0x7fbcb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.214+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbcac0e6fe0 con 0x7fbcc4103620 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.214+0000 7fbcc8e7a640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 0x7fbcb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.214+0000 7fbcc8e7a640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 0x7fbcb00b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4031440 tx=0x7fbcb40314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:16.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.217+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbcac0ad860 con 0x7fbcc4103620 2024-09-21T00:46:16.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.406+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbcc4063fc0 con 0x7fbcc4103620 2024-09-21T00:46:16.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.406+0000 7fbcc1ffb640 1 -- 172.21.15.16:0/3271517875 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fbcac009de0 con 0x7fbcc4103620 2024-09-21T00:46:16.407 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-09-21T00:46:16.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.408+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 msgr2=0x7fbcb00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.408+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 0x7fbcb00b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4031440 tx=0x7fbcb40314a0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.408+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 msgr2=0x7fbcc4199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.408+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00d950 tx=0x7fbcac00de10 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 shutdown_connections 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbcb00b6510 0x7fbcb00b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcc4103fc0 0x7fbcc419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcc4103620 0x7fbcc4199490 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 --2- 172.21.15.16:0/3271517875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc41025a0 0x7fbcc4198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 >> 172.21.15.16:0/3271517875 conn(0x7fbcc40fdee0 msgr2=0x7fbcc4106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 shutdown_connections 2024-09-21T00:46:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.409+0000 7fbccb0de640 1 -- 172.21.15.16:0/3271517875 wait complete. 2024-09-21T00:46:16.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.536+0000 7fe789539640 1 -- 172.21.15.16:0/3888451095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 msgr2=0x7fe784102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.536+0000 7fe789539640 1 --2- 172.21.15.16:0/3888451095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784102a10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe774009900 tx=0x7fe77402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 -- 172.21.15.16:0/3888451095 shutdown_connections 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 --2- 172.21.15.16:0/3888451095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103fc0 0x7fe78410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 --2- 172.21.15.16:0/3888451095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103620 0x7fe784103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 --2- 172.21.15.16:0/3888451095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784102a10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 -- 172.21.15.16:0/3888451095 >> 172.21.15.16:0/3888451095 conn(0x7fe7840fdee0 msgr2=0x7fe784100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 -- 172.21.15.16:0/3888451095 shutdown_connections 2024-09-21T00:46:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 -- 172.21.15.16:0/3888451095 wait complete. 2024-09-21T00:46:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 Processor -- start 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.537+0000 7fe789539640 1 -- start start 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 0x7fe78419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103fc0 0x7fe78419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe78410e1f0 con 0x7fe7841025a0 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe78410e070 con 0x7fe784103fc0 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe789539640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe78410e370 con 0x7fe784103620 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38450/0 (socket says 172.21.15.16:38450) 2024-09-21T00:46:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 -- 172.21.15.16:0/930582995 learned_addr learned my addr 172.21.15.16:0/930582995 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe7837fe640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103fc0 0x7fe78419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe7827fc640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 0x7fe78419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 -- 172.21.15.16:0/930582995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 msgr2=0x7fe78419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 0x7fe78419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 -- 172.21.15.16:0/930582995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103fc0 msgr2=0x7fe78419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103fc0 0x7fe78419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 -- 172.21.15.16:0/930582995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78419b980 con 0x7fe7841025a0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe7827fc640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 0x7fe78419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.538+0000 7fe782ffd640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe774006010 tx=0x7fe774004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.539+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77403f030 con 0x7fe7841025a0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.539+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe774003cb0 con 0x7fe7841025a0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.539+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78419bc10 con 0x7fe7841025a0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.539+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774035070 con 0x7fe7841025a0 2024-09-21T00:46:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.539+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7841a2210 con 0x7fe7841025a0 2024-09-21T00:46:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.540+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7841a2440 con 0x7fe7841025a0 2024-09-21T00:46:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.541+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe774042030 con 0x7fe7841025a0 2024-09-21T00:46:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.542+0000 7fe76bfff640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 0x7fe76c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.542+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe774107530 con 0x7fe7841025a0 2024-09-21T00:46:16.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.542+0000 7fe7827fc640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 0x7fe76c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:16.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.542+0000 7fe7827fc640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 0x7fe76c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe778007e70 tx=0x7fe778007850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:16.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.546+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7740cde50 con 0x7fe7841025a0 2024-09-21T00:46:16.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.735+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe7841a2610 con 0x7fe7841025a0 2024-09-21T00:46:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.736+0000 7fe76bfff640 1 -- 172.21.15.16:0/930582995 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7fe7740d2230 con 0x7fe7841025a0 2024-09-21T00:46:16.737 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-09-21T00:46:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 msgr2=0x7fe76c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 0x7fe76c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe778007e70 tx=0x7fe778007850 comp rx=0 tx=0).stop 2024-09-21T00:46:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 msgr2=0x7fe784199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe774006010 tx=0x7fe774004340 comp rx=0 tx=0).stop 2024-09-21T00:46:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 shutdown_connections 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe76c0b6510 0x7fe76c0b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe784103fc0 0x7fe78419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe784103620 0x7fe78419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 --2- 172.21.15.16:0/930582995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7841025a0 0x7fe784199fd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 >> 172.21.15.16:0/930582995 conn(0x7fe7840fdee0 msgr2=0x7fe7840ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 shutdown_connections 2024-09-21T00:46:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:16.738+0000 7fe789539640 1 -- 172.21.15.16:0/930582995 wait complete. 2024-09-21T00:46:16.749 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:16 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T00:46:16.749 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:16 smithi016 ceph-mon[30947]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:46:16.750 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:16 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3733789380' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:16.750 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:16 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1126656066' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:46:16.751 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T00:46:16.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:46:16.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:16 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T00:46:16.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:16 smithi123 ceph-mon[34853]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:46:16.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:16 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3733789380' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:16.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:16 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1126656066' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:46:16.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:16 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3304927253' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T00:46:16.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:16 smithi178 ceph-mon[34888]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T00:46:16.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:16 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3733789380' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:16.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:16 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1126656066' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.012 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:17 smithi016 ceph-mon[30947]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:46:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3271517875' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:17 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/930582995' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.518+0000 7f4987ce7640 1 -- 172.21.15.16:0/1049013422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 msgr2=0x7f49801087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:17.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.518+0000 7f4987ce7640 1 --2- 172.21.15.16:0/1049013422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f49801087b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4970009900 tx=0x7f497002a410 comp rx=0 tx=0).stop 2024-09-21T00:46:17.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 -- 172.21.15.16:0/1049013422 shutdown_connections 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 --2- 172.21.15.16:0/1049013422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 --2- 172.21.15.16:0/1049013422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f49801087b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 --2- 172.21.15.16:0/1049013422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 0x7f4980102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 -- 172.21.15.16:0/1049013422 >> 172.21.15.16:0/1049013422 conn(0x7f4980079730 msgr2=0x7f4980079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 -- 172.21.15.16:0/1049013422 shutdown_connections 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 -- 172.21.15.16:0/1049013422 wait complete. 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 Processor -- start 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.519+0000 7f4987ce7640 1 -- start start 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 0x7f498019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4980112960 con 0x7f49801083a0 2024-09-21T00:46:17.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f49801127e0 con 0x7f4980102a60 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4987ce7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4980112ae0 con 0x7f4980108cf0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38468/0 (socket says 172.21.15.16:38468) 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 -- 172.21.15.16:0/3018429605 learned_addr learned my addr 172.21.15.16:0/3018429605 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985a83640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 0x7f498019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4986284640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 -- 172.21.15.16:0/3018429605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 msgr2=0x7f498019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 -- 172.21.15.16:0/3018429605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 msgr2=0x7f498019b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 0x7f498019b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 -- 172.21.15.16:0/3018429605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801a6590 con 0x7f49801083a0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4986284640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4985282640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4970032fd0 tx=0x7f4970004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:17.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.520+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497003f030 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.521+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4970004490 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.521+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49801a6820 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.521+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970035070 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.521+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49801a6d50 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.522+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4980102e70 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.523+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4970042030 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.524+0000 7f4976ffd640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 0x7f496c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.524+0000 7f4985a83640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 0x7f496c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.524+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f4970107b40 con 0x7f49801083a0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.525+0000 7f4985a83640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 0x7f496c0b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f498006b9e0 tx=0x7f497c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.527+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49700ce460 con 0x7f49801083a0 2024-09-21T00:46:17.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.758+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f498006b290 con 0x7f49801083a0 2024-09-21T00:46:17.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.759+0000 7f4976ffd640 1 -- 172.21.15.16:0/3018429605 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f498006b290 con 0x7f49801083a0 2024-09-21T00:46:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:17.760 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:46:17.760 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:46:17.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 msgr2=0x7f496c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:17.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 0x7f496c0b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f498006b9e0 tx=0x7f497c00b390 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 msgr2=0x7f498019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4970032fd0 tx=0x7f4970004270 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 shutdown_connections 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f496c0b6590 0x7f496c0b8aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4980108cf0 0x7f498019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49801083a0 0x7f498019b810 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 --2- 172.21.15.16:0/3018429605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4980102a60 0x7f498019b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 >> 172.21.15.16:0/3018429605 conn(0x7f4980079730 msgr2=0x7f49801044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 shutdown_connections 2024-09-21T00:46:17.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:17.761+0000 7f4987ce7640 1 -- 172.21.15.16:0/3018429605 wait complete. 2024-09-21T00:46:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:17 smithi123 ceph-mon[34853]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:46:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:17 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3271517875' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:17 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/930582995' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:17 smithi178 ceph-mon[34888]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:46:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:17 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3271517875' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:46:17.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:17 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/930582995' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:46:18.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:18 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3018429605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:18.554 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T00:46:18.554 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T00:46:18.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:46:18.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 -- 172.21.15.16:0/313544691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44102570 msgr2=0x7f9b441029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 --2- 172.21.15.16:0/313544691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44102570 0x7f9b441029e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009900 tx=0x7f9b3402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 -- 172.21.15.16:0/313544691 shutdown_connections 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 --2- 172.21.15.16:0/313544691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b44103f90 0x7f9b4410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 --2- 172.21.15.16:0/313544691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b441035f0 0x7f9b44103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 --2- 172.21.15.16:0/313544691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44102570 0x7f9b441029e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 -- 172.21.15.16:0/313544691 >> 172.21.15.16:0/313544691 conn(0x7f9b440fdeb0 msgr2=0x7f9b44100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 -- 172.21.15.16:0/313544691 shutdown_connections 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.673+0000 7f9b49aec640 1 -- 172.21.15.16:0/313544691 wait complete. 2024-09-21T00:46:18.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 Processor -- start 2024-09-21T00:46:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 -- start start 2024-09-21T00:46:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b44102570 0x7f9b44198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b441035f0 0x7f9b44199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:18.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4410e1a0 con 0x7f9b44103f90 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4410e020 con 0x7f9b441035f0 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b49aec640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4410e320 con 0x7f9b44102570 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38488/0 (socket says 172.21.15.16:38488) 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.674+0000 7f9b43fff640 1 -- 172.21.15.16:0/1095199092 learned_addr learned my addr 172.21.15.16:0/1095199092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b42ffd640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b441035f0 0x7f9b44199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b437fe640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b44102570 0x7f9b44198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 -- 172.21.15.16:0/1095199092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b44102570 msgr2=0x7f9b44198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b44102570 0x7f9b44198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 -- 172.21.15.16:0/1095199092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b441035f0 msgr2=0x7f9b44199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b441035f0 0x7f9b44199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 -- 172.21.15.16:0/1095199092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4419a860 con 0x7f9b44103f90 2024-09-21T00:46:18.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b43fff640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00eaa0 tx=0x7f9b3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00cdb0 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c005020 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4419ab50 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0116d0 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.675+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4406a900 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.676+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4419adb0 con 0x7f9b44103f90 2024-09-21T00:46:18.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.678+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9b3c0051d0 con 0x7f9b44103f90 2024-09-21T00:46:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.679+0000 7f9b40ff9640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 0x7f9b2c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.679+0000 7f9b437fe640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 0x7f9b2c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.679+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f9b3c0e7800 con 0x7f9b44103f90 2024-09-21T00:46:18.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.680+0000 7f9b437fe640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 0x7f9b2c0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000c00 tx=0x7f9b34031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:18.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.682+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b3c016030 con 0x7f9b44103f90 2024-09-21T00:46:18.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:18 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3018429605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:18.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:18 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3018429605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:18.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.870+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b441092c0 con 0x7f9b2c0b6510 2024-09-21T00:46:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.874+0000 7f9b40ff9640 1 -- 172.21.15.16:0/1095199092 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259096 (secure 0 0 0) 0x7f9b441092c0 con 0x7f9b2c0b6510 2024-09-21T00:46:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:18.879 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:46:18.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 msgr2=0x7f9b2c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 0x7f9b2c0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000c00 tx=0x7f9b34031400 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 msgr2=0x7f9b4419a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00eaa0 tx=0x7f9b3c00ef60 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 shutdown_connections 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9b2c0b6510 0x7f9b2c0b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b44103f90 0x7f9b4419a040 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b441035f0 0x7f9b44199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 --2- 172.21.15.16:0/1095199092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b44102570 0x7f9b44198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 >> 172.21.15.16:0/1095199092 conn(0x7f9b440fdeb0 msgr2=0x7f9b44106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 shutdown_connections 2024-09-21T00:46:18.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:18.878+0000 7f9b49aec640 1 -- 172.21.15.16:0/1095199092 wait complete. 2024-09-21T00:46:18.890 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-21T00:46:18.286529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663387,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1168,"num_read_kb":697,"num_write":388,"num_write_kb":2307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953401,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380272,"kb_used_data":10224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561552,"statfs":{"total":1151940427776,"available":1151551029248,"internally_reserved":0,"allocated":10469376,"data_stored":6772821,"data_compressed":114495,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":67,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662437+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:45:46.662437+0000","last_peered":"2024-09-21T00:45:46.662437+0000","last_clean":"2024-09-21T00:45:46.662437+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:45:46.662437+0000","last_undegraded":"2024-09-21T00:45:46.662437+0000","last_fullsized":"2024-09-21T00:45:46.662437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.647777+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:45:46.647777+0000","last_peered":"2024-09-21T00:45:46.647777+0000","last_clean":"2024-09-21T00:45:46.647777+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:45:46.647777+0000","last_undegraded":"2024-09-21T00:45:46.647777+0000","last_fullsized":"2024-09-21T00:45:46.647777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665670+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:45:46.665670+0000","last_peered":"2024-09-21T00:45:46.665670+0000","last_clean":"2024-09-21T00:45:46.665670+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:45:46.665670+0000","last_undegraded":"2024-09-21T00:45:46.665670+0000","last_fullsized":"2024-09-21T00:45:46.665670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657179+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:45:46.657179+0000","last_peered":"2024-09-21T00:45:46.657179+0000","last_clean":"2024-09-21T00:45:46.657179+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:45:46.657179+0000","last_undegraded":"2024-09-21T00:45:46.657179+0000","last_fullsized":"2024-09-21T00:45:46.657179+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.637510+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:45:46.637510+0000","last_peered":"2024-09-21T00:45:46.637510+0000","last_clean":"2024-09-21T00:45:46.637510+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:45:46.637510+0000","last_undegraded":"2024-09-21T00:45:46.637510+0000","last_fullsized":"2024-09-21T00:45:46.637510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653242+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:45:46.653242+0000","last_peered":"2024-09-21T00:45:46.653242+0000","last_clean":"2024-09-21T00:45:46.653242+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:45:46.653242+0000","last_undegraded":"2024-09-21T00:45:46.653242+0000","last_fullsized":"2024-09-21T00:45:46.653242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665285+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:45:46.665285+0000","last_peered":"2024-09-21T00:45:46.665285+0000","last_clean":"2024-09-21T00:45:46.665285+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:45:46.665285+0000","last_undegraded":"2024-09-21T00:45:46.665285+0000","last_fullsized":"2024-09-21T00:45:46.665285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662453+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:45:46.662453+0000","last_peered":"2024-09-21T00:45:46.662453+0000","last_clean":"2024-09-21T00:45:46.662453+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:45:46.662453+0000","last_undegraded":"2024-09-21T00:45:46.662453+0000","last_fullsized":"2024-09-21T00:45:46.662453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664882+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:45:46.664882+0000","last_peered":"2024-09-21T00:45:46.664882+0000","last_clean":"2024-09-21T00:45:46.664882+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:45:46.664882+0000","last_undegraded":"2024-09-21T00:45:46.664882+0000","last_fullsized":"2024-09-21T00:45:46.664882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.655531+0000","last_change":"2024-09-21T00:44:47.805103+0000","last_active":"2024-09-21T00:45:46.655531+0000","last_peered":"2024-09-21T00:45:46.655531+0000","last_clean":"2024-09-21T00:45:46.655531+0000","last_became_active":"2024-09-21T00:44:47.804708+0000","last_became_peered":"2024-09-21T00:44:47.804708+0000","last_unstale":"2024-09-21T00:45:46.655531+0000","last_undegraded":"2024-09-21T00:45:46.655531+0000","last_fullsized":"2024-09-21T00:45:46.655531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:18.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.668994+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:45:46.668994+0000","last_peered":"2024-09-21T00:45:46.668994+0000","last_clean":"2024-09-21T00:45:46.668994+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:45:46.668994+0000","last_undegraded":"2024-09-21T00:45:46.668994+0000","last_fullsized":"2024-09-21T00:45:46.668994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656611+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:45:46.656611+0000","last_peered":"2024-09-21T00:45:46.656611+0000","last_clean":"2024-09-21T00:45:46.656611+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:45:46.656611+0000","last_undegraded":"2024-09-21T00:45:46.656611+0000","last_fullsized":"2024-09-21T00:45:46.656611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656622+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:45:46.656622+0000","last_peered":"2024-09-21T00:45:46.656622+0000","last_clean":"2024-09-21T00:45:46.656622+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:45:46.656622+0000","last_undegraded":"2024-09-21T00:45:46.656622+0000","last_fullsized":"2024-09-21T00:45:46.656622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653444+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:45:46.653444+0000","last_peered":"2024-09-21T00:45:46.653444+0000","last_clean":"2024-09-21T00:45:46.653444+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:45:46.653444+0000","last_undegraded":"2024-09-21T00:45:46.653444+0000","last_fullsized":"2024-09-21T00:45:46.653444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656861+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:45:46.656861+0000","last_peered":"2024-09-21T00:45:46.656861+0000","last_clean":"2024-09-21T00:45:46.656861+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:45:46.656861+0000","last_undegraded":"2024-09-21T00:45:46.656861+0000","last_fullsized":"2024-09-21T00:45:46.656861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667185+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:45:46.667185+0000","last_peered":"2024-09-21T00:45:46.667185+0000","last_clean":"2024-09-21T00:45:46.667185+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:45:46.667185+0000","last_undegraded":"2024-09-21T00:45:46.667185+0000","last_fullsized":"2024-09-21T00:45:46.667185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662605+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:45:46.662605+0000","last_peered":"2024-09-21T00:45:46.662605+0000","last_clean":"2024-09-21T00:45:46.662605+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:45:46.662605+0000","last_undegraded":"2024-09-21T00:45:46.662605+0000","last_fullsized":"2024-09-21T00:45:46.662605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.631611+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:45:46.631611+0000","last_peered":"2024-09-21T00:45:46.631611+0000","last_clean":"2024-09-21T00:45:46.631611+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:45:46.631611+0000","last_undegraded":"2024-09-21T00:45:46.631611+0000","last_fullsized":"2024-09-21T00:45:46.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652940+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:45:46.652940+0000","last_peered":"2024-09-21T00:45:46.652940+0000","last_clean":"2024-09-21T00:45:46.652940+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:45:46.652940+0000","last_undegraded":"2024-09-21T00:45:46.652940+0000","last_fullsized":"2024-09-21T00:45:46.652940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659370+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:45:46.659370+0000","last_peered":"2024-09-21T00:45:46.659370+0000","last_clean":"2024-09-21T00:45:46.659370+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:45:46.659370+0000","last_undegraded":"2024-09-21T00:45:46.659370+0000","last_fullsized":"2024-09-21T00:45:46.659370+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669392+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:45:46.669392+0000","last_peered":"2024-09-21T00:45:46.669392+0000","last_clean":"2024-09-21T00:45:46.669392+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:45:46.669392+0000","last_undegraded":"2024-09-21T00:45:46.669392+0000","last_fullsized":"2024-09-21T00:45:46.669392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667802+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:45:46.667802+0000","last_peered":"2024-09-21T00:45:46.667802+0000","last_clean":"2024-09-21T00:45:46.667802+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:45:46.667802+0000","last_undegraded":"2024-09-21T00:45:46.667802+0000","last_fullsized":"2024-09-21T00:45:46.667802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657145+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:45:46.657145+0000","last_peered":"2024-09-21T00:45:46.657145+0000","last_clean":"2024-09-21T00:45:46.657145+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:45:46.657145+0000","last_undegraded":"2024-09-21T00:45:46.657145+0000","last_fullsized":"2024-09-21T00:45:46.657145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.644918+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:45:46.644918+0000","last_peered":"2024-09-21T00:45:46.644918+0000","last_clean":"2024-09-21T00:45:46.644918+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:45:46.644918+0000","last_undegraded":"2024-09-21T00:45:46.644918+0000","last_fullsized":"2024-09-21T00:45:46.644918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659450+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:45:46.659450+0000","last_peered":"2024-09-21T00:45:46.659450+0000","last_clean":"2024-09-21T00:45:46.659450+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:45:46.659450+0000","last_undegraded":"2024-09-21T00:45:46.659450+0000","last_fullsized":"2024-09-21T00:45:46.659450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639694+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:45:46.639694+0000","last_peered":"2024-09-21T00:45:46.639694+0000","last_clean":"2024-09-21T00:45:46.639694+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:45:46.639694+0000","last_undegraded":"2024-09-21T00:45:46.639694+0000","last_fullsized":"2024-09-21T00:45:46.639694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661110+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:45:46.661110+0000","last_peered":"2024-09-21T00:45:46.661110+0000","last_clean":"2024-09-21T00:45:46.661110+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:45:46.661110+0000","last_undegraded":"2024-09-21T00:45:46.661110+0000","last_fullsized":"2024-09-21T00:45:46.661110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.658982+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:45:46.658982+0000","last_peered":"2024-09-21T00:45:46.658982+0000","last_clean":"2024-09-21T00:45:46.658982+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:45:46.658982+0000","last_undegraded":"2024-09-21T00:45:46.658982+0000","last_fullsized":"2024-09-21T00:45:46.658982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656929+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:45:46.656929+0000","last_peered":"2024-09-21T00:45:46.656929+0000","last_clean":"2024-09-21T00:45:46.656929+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:45:46.656929+0000","last_undegraded":"2024-09-21T00:45:46.656929+0000","last_fullsized":"2024-09-21T00:45:46.656929+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652278+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:45:46.652278+0000","last_peered":"2024-09-21T00:45:46.652278+0000","last_clean":"2024-09-21T00:45:46.652278+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:45:46.652278+0000","last_undegraded":"2024-09-21T00:45:46.652278+0000","last_fullsized":"2024-09-21T00:45:46.652278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.641175+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:45:46.641175+0000","last_peered":"2024-09-21T00:45:46.641175+0000","last_clean":"2024-09-21T00:45:46.641175+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:45:46.641175+0000","last_undegraded":"2024-09-21T00:45:46.641175+0000","last_fullsized":"2024-09-21T00:45:46.641175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661244+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:45:46.661244+0000","last_peered":"2024-09-21T00:45:46.661244+0000","last_clean":"2024-09-21T00:45:46.661244+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:45:46.661244+0000","last_undegraded":"2024-09-21T00:45:46.661244+0000","last_fullsized":"2024-09-21T00:45:46.661244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639445+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:45:46.639445+0000","last_peered":"2024-09-21T00:45:46.639445+0000","last_clean":"2024-09-21T00:45:46.639445+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:45:46.639445+0000","last_undegraded":"2024-09-21T00:45:46.639445+0000","last_fullsized":"2024-09-21T00:45:46.639445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:16.924199+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:46:16.924199+0000","last_peered":"2024-09-21T00:46:16.924199+0000","last_clean":"2024-09-21T00:46:16.924199+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:46:16.924199+0000","last_undegraded":"2024-09-21T00:46:16.924199+0000","last_fullsized":"2024-09-21T00:46:16.924199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660197+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:45:46.660197+0000","last_peered":"2024-09-21T00:45:46.660197+0000","last_clean":"2024-09-21T00:45:46.660197+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:45:46.660197+0000","last_undegraded":"2024-09-21T00:45:46.660197+0000","last_fullsized":"2024-09-21T00:45:46.660197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797980+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:47.797980+0000","last_peered":"2024-09-21T00:44:47.797980+0000","last_clean":"2024-09-21T00:44:47.797980+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:47.797980+0000","last_undegraded":"2024-09-21T00:44:47.797980+0000","last_fullsized":"2024-09-21T00:44:47.797980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799446+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:47.799446+0000","last_peered":"2024-09-21T00:44:47.799446+0000","last_clean":"2024-09-21T00:44:47.799446+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:47.799446+0000","last_undegraded":"2024-09-21T00:44:47.799446+0000","last_fullsized":"2024-09-21T00:44:47.799446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.654634+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:45:46.654634+0000","last_peered":"2024-09-21T00:45:46.654634+0000","last_clean":"2024-09-21T00:45:46.654634+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:45:46.654634+0000","last_undegraded":"2024-09-21T00:45:46.654634+0000","last_fullsized":"2024-09-21T00:45:46.654634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803565+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:47.803565+0000","last_peered":"2024-09-21T00:44:47.803565+0000","last_clean":"2024-09-21T00:44:47.803565+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:47.803565+0000","last_undegraded":"2024-09-21T00:44:47.803565+0000","last_fullsized":"2024-09-21T00:44:47.803565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639907+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:45:46.639907+0000","last_peered":"2024-09-21T00:45:46.639907+0000","last_clean":"2024-09-21T00:45:46.639907+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:45:46.639907+0000","last_undegraded":"2024-09-21T00:45:46.639907+0000","last_fullsized":"2024-09-21T00:45:46.639907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922329+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:46:15.922329+0000","last_peered":"2024-09-21T00:46:15.922329+0000","last_clean":"2024-09-21T00:46:15.922329+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:46:15.922329+0000","last_undegraded":"2024-09-21T00:46:15.922329+0000","last_fullsized":"2024-09-21T00:46:15.922329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664901+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:45:46.664901+0000","last_peered":"2024-09-21T00:45:46.664901+0000","last_clean":"2024-09-21T00:45:46.664901+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:45:46.664901+0000","last_undegraded":"2024-09-21T00:45:46.664901+0000","last_fullsized":"2024-09-21T00:45:46.664901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799157+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:47.799157+0000","last_peered":"2024-09-21T00:44:47.799157+0000","last_clean":"2024-09-21T00:44:47.799157+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:47.799157+0000","last_undegraded":"2024-09-21T00:44:47.799157+0000","last_fullsized":"2024-09-21T00:44:47.799157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656754+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:45:46.656754+0000","last_peered":"2024-09-21T00:45:46.656754+0000","last_clean":"2024-09-21T00:45:46.656754+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:45:46.656754+0000","last_undegraded":"2024-09-21T00:45:46.656754+0000","last_fullsized":"2024-09-21T00:45:46.656754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803641+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:47.803641+0000","last_peered":"2024-09-21T00:44:47.803641+0000","last_clean":"2024-09-21T00:44:47.803641+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:47.803641+0000","last_undegraded":"2024-09-21T00:44:47.803641+0000","last_fullsized":"2024-09-21T00:44:47.803641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662877+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:45:46.662877+0000","last_peered":"2024-09-21T00:45:46.662877+0000","last_clean":"2024-09-21T00:45:46.662877+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:45:46.662877+0000","last_undegraded":"2024-09-21T00:45:46.662877+0000","last_fullsized":"2024-09-21T00:45:46.662877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922109+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:46:15.922109+0000","last_peered":"2024-09-21T00:46:15.922109+0000","last_clean":"2024-09-21T00:46:15.922109+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:46:15.922109+0000","last_undegraded":"2024-09-21T00:46:15.922109+0000","last_fullsized":"2024-09-21T00:46:15.922109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":222,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660825+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:45:46.660825+0000","last_peered":"2024-09-21T00:45:46.660825+0000","last_clean":"2024-09-21T00:45:46.660825+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:45:46.660825+0000","last_undegraded":"2024-09-21T00:45:46.660825+0000","last_fullsized":"2024-09-21T00:45:46.660825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803229+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:47.803229+0000","last_peered":"2024-09-21T00:44:47.803229+0000","last_clean":"2024-09-21T00:44:47.803229+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:47.803229+0000","last_undegraded":"2024-09-21T00:44:47.803229+0000","last_fullsized":"2024-09-21T00:44:47.803229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.666651+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:45:46.666651+0000","last_peered":"2024-09-21T00:45:46.666651+0000","last_clean":"2024-09-21T00:45:46.666651+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:45:46.666651+0000","last_undegraded":"2024-09-21T00:45:46.666651+0000","last_fullsized":"2024-09-21T00:45:46.666651+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803744+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:47.803744+0000","last_peered":"2024-09-21T00:44:47.803744+0000","last_clean":"2024-09-21T00:44:47.803744+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:47.803744+0000","last_undegraded":"2024-09-21T00:44:47.803744+0000","last_fullsized":"2024-09-21T00:44:47.803744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669904+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:45:46.669904+0000","last_peered":"2024-09-21T00:45:46.669904+0000","last_clean":"2024-09-21T00:45:46.669904+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:45:46.669904+0000","last_undegraded":"2024-09-21T00:45:46.669904+0000","last_fullsized":"2024-09-21T00:45:46.669904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.923130+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:46:15.923130+0000","last_peered":"2024-09-21T00:46:15.923130+0000","last_clean":"2024-09-21T00:46:15.923130+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:46:15.923130+0000","last_undegraded":"2024-09-21T00:46:15.923130+0000","last_fullsized":"2024-09-21T00:46:15.923130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665203+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:45:46.665203+0000","last_peered":"2024-09-21T00:45:46.665203+0000","last_clean":"2024-09-21T00:45:46.665203+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:45:46.665203+0000","last_undegraded":"2024-09-21T00:45:46.665203+0000","last_fullsized":"2024-09-21T00:45:46.665203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799995+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:47.799995+0000","last_peered":"2024-09-21T00:44:47.799995+0000","last_clean":"2024-09-21T00:44:47.799995+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:47.799995+0000","last_undegraded":"2024-09-21T00:44:47.799995+0000","last_fullsized":"2024-09-21T00:44:47.799995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.633578+0000","last_change":"2024-09-21T00:44:47.844546+0000","last_active":"2024-09-21T00:45:46.633578+0000","last_peered":"2024-09-21T00:45:46.633578+0000","last_clean":"2024-09-21T00:45:46.633578+0000","last_became_active":"2024-09-21T00:44:47.844212+0000","last_became_peered":"2024-09-21T00:44:47.844212+0000","last_unstale":"2024-09-21T00:45:46.633578+0000","last_undegraded":"2024-09-21T00:45:46.633578+0000","last_fullsized":"2024-09-21T00:45:46.633578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.265217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800471+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:47.800471+0000","last_peered":"2024-09-21T00:44:47.800471+0000","last_clean":"2024-09-21T00:44:47.800471+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:47.800471+0000","last_undegraded":"2024-09-21T00:44:47.800471+0000","last_fullsized":"2024-09-21T00:44:47.800471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660579+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:45:46.660579+0000","last_peered":"2024-09-21T00:45:46.660579+0000","last_clean":"2024-09-21T00:45:46.660579+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:45:46.660579+0000","last_undegraded":"2024-09-21T00:45:46.660579+0000","last_fullsized":"2024-09-21T00:45:46.660579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799596+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:47.799596+0000","last_peered":"2024-09-21T00:44:47.799596+0000","last_clean":"2024-09-21T00:44:47.799596+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:47.799596+0000","last_undegraded":"2024-09-21T00:44:47.799596+0000","last_fullsized":"2024-09-21T00:44:47.799596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665239+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:45:46.665239+0000","last_peered":"2024-09-21T00:45:46.665239+0000","last_clean":"2024-09-21T00:45:46.665239+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:45:46.665239+0000","last_undegraded":"2024-09-21T00:45:46.665239+0000","last_fullsized":"2024-09-21T00:45:46.665239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803777+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:47.803777+0000","last_peered":"2024-09-21T00:44:47.803777+0000","last_clean":"2024-09-21T00:44:47.803777+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:47.803777+0000","last_undegraded":"2024-09-21T00:44:47.803777+0000","last_fullsized":"2024-09-21T00:44:47.803777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664948+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:45:46.664948+0000","last_peered":"2024-09-21T00:45:46.664948+0000","last_clean":"2024-09-21T00:45:46.664948+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:45:46.664948+0000","last_undegraded":"2024-09-21T00:45:46.664948+0000","last_fullsized":"2024-09-21T00:45:46.664948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'7","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.951673+0000","last_change":"2024-09-21T00:44:47.811552+0000","last_active":"2024-09-21T00:46:15.951673+0000","last_peered":"2024-09-21T00:46:15.951673+0000","last_clean":"2024-09-21T00:46:15.951673+0000","last_became_active":"2024-09-21T00:44:47.804091+0000","last_became_peered":"2024-09-21T00:44:47.804091+0000","last_unstale":"2024-09-21T00:46:15.951673+0000","last_undegraded":"2024-09-21T00:46:15.951673+0000","last_fullsized":"2024-09-21T00:46:15.951673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:58.491825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1561,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669130+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:45:46.669130+0000","last_peered":"2024-09-21T00:45:46.669130+0000","last_clean":"2024-09-21T00:45:46.669130+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:45:46.669130+0000","last_undegraded":"2024-09-21T00:45:46.669130+0000","last_fullsized":"2024-09-21T00:45:46.669130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":99,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799301+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:47.799301+0000","last_peered":"2024-09-21T00:44:47.799301+0000","last_clean":"2024-09-21T00:44:47.799301+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:47.799301+0000","last_undegraded":"2024-09-21T00:44:47.799301+0000","last_fullsized":"2024-09-21T00:44:47.799301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800400+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:47.800400+0000","last_peered":"2024-09-21T00:44:47.800400+0000","last_clean":"2024-09-21T00:44:47.800400+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:47.800400+0000","last_undegraded":"2024-09-21T00:44:47.800400+0000","last_fullsized":"2024-09-21T00:44:47.800400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665246+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:45:46.665246+0000","last_peered":"2024-09-21T00:45:46.665246+0000","last_clean":"2024-09-21T00:45:46.665246+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:45:46.665246+0000","last_undegraded":"2024-09-21T00:45:46.665246+0000","last_fullsized":"2024-09-21T00:45:46.665246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.808921+0000","last_change":"2024-09-21T00:44:47.808807+0000","last_active":"2024-09-21T00:44:47.808921+0000","last_peered":"2024-09-21T00:44:47.808921+0000","last_clean":"2024-09-21T00:44:47.808921+0000","last_became_active":"2024-09-21T00:44:47.805581+0000","last_became_peered":"2024-09-21T00:44:47.805581+0000","last_unstale":"2024-09-21T00:44:47.808921+0000","last_undegraded":"2024-09-21T00:44:47.808921+0000","last_fullsized":"2024-09-21T00:44:47.808921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.570140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.646995+0000","last_change":"2024-09-21T00:44:47.804921+0000","last_active":"2024-09-21T00:45:46.646995+0000","last_peered":"2024-09-21T00:45:46.646995+0000","last_clean":"2024-09-21T00:45:46.646995+0000","last_became_active":"2024-09-21T00:44:47.804531+0000","last_became_peered":"2024-09-21T00:44:47.804531+0000","last_unstale":"2024-09-21T00:45:46.646995+0000","last_undegraded":"2024-09-21T00:45:46.646995+0000","last_fullsized":"2024-09-21T00:45:46.646995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:56.462438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:13.918505+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:46:13.918505+0000","last_peered":"2024-09-21T00:46:13.918505+0000","last_clean":"2024-09-21T00:46:13.918505+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:46:13.918505+0000","last_undegraded":"2024-09-21T00:46:13.918505+0000","last_fullsized":"2024-09-21T00:46:13.918505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661217+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:45:46.661217+0000","last_peered":"2024-09-21T00:45:46.661217+0000","last_clean":"2024-09-21T00:45:46.661217+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:45:46.661217+0000","last_undegraded":"2024-09-21T00:45:46.661217+0000","last_fullsized":"2024-09-21T00:45:46.661217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'7","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:12.917527+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:46:12.917527+0000","last_peered":"2024-09-21T00:46:12.917527+0000","last_clean":"2024-09-21T00:46:12.917527+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:46:12.917527+0000","last_undegraded":"2024-09-21T00:46:12.917527+0000","last_fullsized":"2024-09-21T00:46:12.917527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652794+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:45:46.652794+0000","last_peered":"2024-09-21T00:45:46.652794+0000","last_clean":"2024-09-21T00:45:46.652794+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:45:46.652794+0000","last_undegraded":"2024-09-21T00:45:46.652794+0000","last_fullsized":"2024-09-21T00:45:46.652794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796811+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:47.796811+0000","last_peered":"2024-09-21T00:44:47.796811+0000","last_clean":"2024-09-21T00:44:47.796811+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:47.796811+0000","last_undegraded":"2024-09-21T00:44:47.796811+0000","last_fullsized":"2024-09-21T00:44:47.796811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660885+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:45:46.660885+0000","last_peered":"2024-09-21T00:45:46.660885+0000","last_clean":"2024-09-21T00:45:46.660885+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:45:46.660885+0000","last_undegraded":"2024-09-21T00:45:46.660885+0000","last_fullsized":"2024-09-21T00:45:46.660885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800530+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:47.800530+0000","last_peered":"2024-09-21T00:44:47.800530+0000","last_clean":"2024-09-21T00:44:47.800530+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:47.800530+0000","last_undegraded":"2024-09-21T00:44:47.800530+0000","last_fullsized":"2024-09-21T00:44:47.800530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.650572+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:45:46.650572+0000","last_peered":"2024-09-21T00:45:46.650572+0000","last_clean":"2024-09-21T00:45:46.650572+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:45:46.650572+0000","last_undegraded":"2024-09-21T00:45:46.650572+0000","last_fullsized":"2024-09-21T00:45:46.650572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'18","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.698553+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:45:46.698553+0000","last_peered":"2024-09-21T00:45:46.698553+0000","last_clean":"2024-09-21T00:45:46.698553+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:45:46.698553+0000","last_undegraded":"2024-09-21T00:45:46.698553+0000","last_fullsized":"2024-09-21T00:45:46.698553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.663883+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:45:46.663883+0000","last_peered":"2024-09-21T00:45:46.663883+0000","last_clean":"2024-09-21T00:45:46.663883+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:45:46.663883+0000","last_undegraded":"2024-09-21T00:45:46.663883+0000","last_fullsized":"2024-09-21T00:45:46.663883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800939+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:47.800939+0000","last_peered":"2024-09-21T00:44:47.800939+0000","last_clean":"2024-09-21T00:44:47.800939+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:47.800939+0000","last_undegraded":"2024-09-21T00:44:47.800939+0000","last_fullsized":"2024-09-21T00:44:47.800939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657262+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:45:46.657262+0000","last_peered":"2024-09-21T00:45:46.657262+0000","last_clean":"2024-09-21T00:45:46.657262+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:45:46.657262+0000","last_undegraded":"2024-09-21T00:45:46.657262+0000","last_fullsized":"2024-09-21T00:45:46.657262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843924+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:47.843924+0000","last_peered":"2024-09-21T00:44:47.843924+0000","last_clean":"2024-09-21T00:44:47.843924+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:47.843924+0000","last_undegraded":"2024-09-21T00:44:47.843924+0000","last_fullsized":"2024-09-21T00:44:47.843924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.613199+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:45:46.613199+0000","last_peered":"2024-09-21T00:45:46.613199+0000","last_clean":"2024-09-21T00:45:46.613199+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:45:46.613199+0000","last_undegraded":"2024-09-21T00:45:46.613199+0000","last_fullsized":"2024-09-21T00:45:46.613199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800965+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:47.800965+0000","last_peered":"2024-09-21T00:44:47.800965+0000","last_clean":"2024-09-21T00:44:47.800965+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:47.800965+0000","last_undegraded":"2024-09-21T00:44:47.800965+0000","last_fullsized":"2024-09-21T00:44:47.800965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652879+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:45:46.652879+0000","last_peered":"2024-09-21T00:45:46.652879+0000","last_clean":"2024-09-21T00:45:46.652879+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:45:46.652879+0000","last_undegraded":"2024-09-21T00:45:46.652879+0000","last_fullsized":"2024-09-21T00:45:46.652879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803471+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:47.803471+0000","last_peered":"2024-09-21T00:44:47.803471+0000","last_clean":"2024-09-21T00:44:47.803471+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:47.803471+0000","last_undegraded":"2024-09-21T00:44:47.803471+0000","last_fullsized":"2024-09-21T00:44:47.803471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661403+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:45:46.661403+0000","last_peered":"2024-09-21T00:45:46.661403+0000","last_clean":"2024-09-21T00:45:46.661403+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:45:46.661403+0000","last_undegraded":"2024-09-21T00:45:46.661403+0000","last_fullsized":"2024-09-21T00:45:46.661403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800088+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:47.800088+0000","last_peered":"2024-09-21T00:44:47.800088+0000","last_clean":"2024-09-21T00:44:47.800088+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:47.800088+0000","last_undegraded":"2024-09-21T00:44:47.800088+0000","last_fullsized":"2024-09-21T00:44:47.800088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669311+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:45:46.669311+0000","last_peered":"2024-09-21T00:45:46.669311+0000","last_clean":"2024-09-21T00:45:46.669311+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:45:46.669311+0000","last_undegraded":"2024-09-21T00:45:46.669311+0000","last_fullsized":"2024-09-21T00:45:46.669311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660563+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:45:46.660563+0000","last_peered":"2024-09-21T00:45:46.660563+0000","last_clean":"2024-09-21T00:45:46.660563+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:45:46.660563+0000","last_undegraded":"2024-09-21T00:45:46.660563+0000","last_fullsized":"2024-09-21T00:45:46.660563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799986+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:47.799986+0000","last_peered":"2024-09-21T00:44:47.799986+0000","last_clean":"2024-09-21T00:44:47.799986+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:47.799986+0000","last_undegraded":"2024-09-21T00:44:47.799986+0000","last_fullsized":"2024-09-21T00:44:47.799986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664461+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:45:46.664461+0000","last_peered":"2024-09-21T00:45:46.664461+0000","last_clean":"2024-09-21T00:45:46.664461+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:45:46.664461+0000","last_undegraded":"2024-09-21T00:45:46.664461+0000","last_fullsized":"2024-09-21T00:45:46.664461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.862814+0000","last_change":"2024-09-21T00:44:47.862708+0000","last_active":"2024-09-21T00:44:47.862814+0000","last_peered":"2024-09-21T00:44:47.862814+0000","last_clean":"2024-09-21T00:44:47.862814+0000","last_became_active":"2024-09-21T00:44:47.845236+0000","last_became_peered":"2024-09-21T00:44:47.845236+0000","last_unstale":"2024-09-21T00:44:47.862814+0000","last_undegraded":"2024-09-21T00:44:47.862814+0000","last_fullsized":"2024-09-21T00:44:47.862814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:03.770440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665993+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:45:46.665993+0000","last_peered":"2024-09-21T00:45:46.665993+0000","last_clean":"2024-09-21T00:45:46.665993+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:45:46.665993+0000","last_undegraded":"2024-09-21T00:45:46.665993+0000","last_fullsized":"2024-09-21T00:45:46.665993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801639+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:47.801639+0000","last_peered":"2024-09-21T00:44:47.801639+0000","last_clean":"2024-09-21T00:44:47.801639+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:47.801639+0000","last_undegraded":"2024-09-21T00:44:47.801639+0000","last_fullsized":"2024-09-21T00:44:47.801639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657452+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:45:46.657452+0000","last_peered":"2024-09-21T00:45:46.657452+0000","last_clean":"2024-09-21T00:45:46.657452+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:45:46.657452+0000","last_undegraded":"2024-09-21T00:45:46.657452+0000","last_fullsized":"2024-09-21T00:45:46.657452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":144,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:14.919696+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:46:14.919696+0000","last_peered":"2024-09-21T00:46:14.919696+0000","last_clean":"2024-09-21T00:46:14.919696+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:46:14.919696+0000","last_undegraded":"2024-09-21T00:46:14.919696+0000","last_fullsized":"2024-09-21T00:46:14.919696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72785,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1092,"num_read_kb":633,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1561,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":218355,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":400279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1055543,"data_compressed":38165,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":399677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":400055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":993554,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724607,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":399926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920836,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":992392,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084362,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":399219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":464348,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465298,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66743,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65793,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66503,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:46:18.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 -- 172.21.15.16:0/2888206019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 msgr2=0x7f8fe810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2888206019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe810a960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009c90 tx=0x7f8fe002a860 comp rx=0 tx=0).stop 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 -- 172.21.15.16:0/2888206019 shutdown_connections 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2888206019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe810a960 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2888206019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe8103620 0x7f8fe8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2888206019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe81025a0 0x7f8fe8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 -- 172.21.15.16:0/2888206019 >> 172.21.15.16:0/2888206019 conn(0x7f8fe80fdee0 msgr2=0x7f8fe8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:19.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 -- 172.21.15.16:0/2888206019 shutdown_connections 2024-09-21T00:46:19.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.043+0000 7f8feff7b640 1 -- 172.21.15.16:0/2888206019 wait complete. 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 Processor -- start 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 -- start start 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe81025a0 0x7f8fe8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe8103620 0x7f8fe819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe810f390 con 0x7f8fe8103fc0 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe810f210 con 0x7f8fe81025a0 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8feff7b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe810f510 con 0x7f8fe8103620 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8fee518640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8fee518640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38498/0 (socket says 172.21.15.16:38498) 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8fee518640 1 -- 172.21.15.16:0/2139057014 learned_addr learned my addr 172.21.15.16:0/2139057014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8fed516640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe8103620 0x7f8fe819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.044+0000 7f8fedd17640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe81025a0 0x7f8fe8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 -- 172.21.15.16:0/2139057014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe8103620 msgr2=0x7f8fe819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe8103620 0x7f8fe819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 -- 172.21.15.16:0/2139057014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe81025a0 msgr2=0x7f8fe8199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe81025a0 0x7f8fe8199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 -- 172.21.15.16:0/2139057014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe819b910 con 0x7f8fe8103fc0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fee518640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00318e0 tx=0x7f8fe0004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0030560 con 0x7f8fe8103fc0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe0030bb0 con 0x7f8fe8103fc0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe819bba0 con 0x7f8fe8103fc0 2024-09-21T00:46:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe003cc60 con 0x7f8fe8103fc0 2024-09-21T00:46:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.045+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81a22f0 con 0x7f8fe8103fc0 2024-09-21T00:46:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.046+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe8102a10 con 0x7f8fe8103fc0 2024-09-21T00:46:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.048+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8fe003c410 con 0x7f8fe8103fc0 2024-09-21T00:46:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.048+0000 7f8fdeffd640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 0x7f8fd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.048+0000 7f8fedd17640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 0x7f8fd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.048+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8fe0108480 con 0x7f8fe8103fc0 2024-09-21T00:46:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.049+0000 7f8fedd17640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 0x7f8fd40b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4005fd0 tx=0x7f8fe4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:19.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.051+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fe00ceda0 con 0x7f8fe8103fc0 2024-09-21T00:46:19.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.237+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fe8063800 con 0x7f8fd40b6510 2024-09-21T00:46:19.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.241+0000 7f8fdeffd640 1 -- 172.21.15.16:0/2139057014 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259096 (secure 0 0 0) 0x7f8fe8063800 con 0x7f8fd40b6510 2024-09-21T00:46:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:19.246 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:46:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.244+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 msgr2=0x7f8fd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.244+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 0x7f8fd40b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4005fd0 tx=0x7f8fe4005850 comp rx=0 tx=0).stop 2024-09-21T00:46:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.244+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 msgr2=0x7f8fe819b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.244+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00318e0 tx=0x7f8fe0004cc0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 shutdown_connections 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8fd40b6510 0x7f8fd40b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe8103fc0 0x7f8fe819b0f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe8103620 0x7f8fe819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 --2- 172.21.15.16:0/2139057014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe81025a0 0x7f8fe8199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 >> 172.21.15.16:0/2139057014 conn(0x7f8fe80fdee0 msgr2=0x7f8fe8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 shutdown_connections 2024-09-21T00:46:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.245+0000 7f8feff7b640 1 -- 172.21.15.16:0/2139057014 wait complete. 2024-09-21T00:46:19.257 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-21T00:46:18.286529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663387,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1168,"num_read_kb":697,"num_write":388,"num_write_kb":2307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953401,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380272,"kb_used_data":10224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561552,"statfs":{"total":1151940427776,"available":1151551029248,"internally_reserved":0,"allocated":10469376,"data_stored":6772821,"data_compressed":114495,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":67,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662437+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:45:46.662437+0000","last_peered":"2024-09-21T00:45:46.662437+0000","last_clean":"2024-09-21T00:45:46.662437+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:45:46.662437+0000","last_undegraded":"2024-09-21T00:45:46.662437+0000","last_fullsized":"2024-09-21T00:45:46.662437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.647777+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:45:46.647777+0000","last_peered":"2024-09-21T00:45:46.647777+0000","last_clean":"2024-09-21T00:45:46.647777+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:45:46.647777+0000","last_undegraded":"2024-09-21T00:45:46.647777+0000","last_fullsized":"2024-09-21T00:45:46.647777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665670+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:45:46.665670+0000","last_peered":"2024-09-21T00:45:46.665670+0000","last_clean":"2024-09-21T00:45:46.665670+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:45:46.665670+0000","last_undegraded":"2024-09-21T00:45:46.665670+0000","last_fullsized":"2024-09-21T00:45:46.665670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657179+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:45:46.657179+0000","last_peered":"2024-09-21T00:45:46.657179+0000","last_clean":"2024-09-21T00:45:46.657179+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:45:46.657179+0000","last_undegraded":"2024-09-21T00:45:46.657179+0000","last_fullsized":"2024-09-21T00:45:46.657179+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.637510+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:45:46.637510+0000","last_peered":"2024-09-21T00:45:46.637510+0000","last_clean":"2024-09-21T00:45:46.637510+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:45:46.637510+0000","last_undegraded":"2024-09-21T00:45:46.637510+0000","last_fullsized":"2024-09-21T00:45:46.637510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653242+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:45:46.653242+0000","last_peered":"2024-09-21T00:45:46.653242+0000","last_clean":"2024-09-21T00:45:46.653242+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:45:46.653242+0000","last_undegraded":"2024-09-21T00:45:46.653242+0000","last_fullsized":"2024-09-21T00:45:46.653242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665285+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:45:46.665285+0000","last_peered":"2024-09-21T00:45:46.665285+0000","last_clean":"2024-09-21T00:45:46.665285+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:45:46.665285+0000","last_undegraded":"2024-09-21T00:45:46.665285+0000","last_fullsized":"2024-09-21T00:45:46.665285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662453+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:45:46.662453+0000","last_peered":"2024-09-21T00:45:46.662453+0000","last_clean":"2024-09-21T00:45:46.662453+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:45:46.662453+0000","last_undegraded":"2024-09-21T00:45:46.662453+0000","last_fullsized":"2024-09-21T00:45:46.662453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664882+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:45:46.664882+0000","last_peered":"2024-09-21T00:45:46.664882+0000","last_clean":"2024-09-21T00:45:46.664882+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:45:46.664882+0000","last_undegraded":"2024-09-21T00:45:46.664882+0000","last_fullsized":"2024-09-21T00:45:46.664882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.655531+0000","last_change":"2024-09-21T00:44:47.805103+0000","last_active":"2024-09-21T00:45:46.655531+0000","last_peered":"2024-09-21T00:45:46.655531+0000","last_clean":"2024-09-21T00:45:46.655531+0000","last_became_active":"2024-09-21T00:44:47.804708+0000","last_became_peered":"2024-09-21T00:44:47.804708+0000","last_unstale":"2024-09-21T00:45:46.655531+0000","last_undegraded":"2024-09-21T00:45:46.655531+0000","last_fullsized":"2024-09-21T00:45:46.655531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:18.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.668994+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:45:46.668994+0000","last_peered":"2024-09-21T00:45:46.668994+0000","last_clean":"2024-09-21T00:45:46.668994+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:45:46.668994+0000","last_undegraded":"2024-09-21T00:45:46.668994+0000","last_fullsized":"2024-09-21T00:45:46.668994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656611+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:45:46.656611+0000","last_peered":"2024-09-21T00:45:46.656611+0000","last_clean":"2024-09-21T00:45:46.656611+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:45:46.656611+0000","last_undegraded":"2024-09-21T00:45:46.656611+0000","last_fullsized":"2024-09-21T00:45:46.656611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656622+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:45:46.656622+0000","last_peered":"2024-09-21T00:45:46.656622+0000","last_clean":"2024-09-21T00:45:46.656622+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:45:46.656622+0000","last_undegraded":"2024-09-21T00:45:46.656622+0000","last_fullsized":"2024-09-21T00:45:46.656622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653444+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:45:46.653444+0000","last_peered":"2024-09-21T00:45:46.653444+0000","last_clean":"2024-09-21T00:45:46.653444+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:45:46.653444+0000","last_undegraded":"2024-09-21T00:45:46.653444+0000","last_fullsized":"2024-09-21T00:45:46.653444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656861+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:45:46.656861+0000","last_peered":"2024-09-21T00:45:46.656861+0000","last_clean":"2024-09-21T00:45:46.656861+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:45:46.656861+0000","last_undegraded":"2024-09-21T00:45:46.656861+0000","last_fullsized":"2024-09-21T00:45:46.656861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667185+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:45:46.667185+0000","last_peered":"2024-09-21T00:45:46.667185+0000","last_clean":"2024-09-21T00:45:46.667185+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:45:46.667185+0000","last_undegraded":"2024-09-21T00:45:46.667185+0000","last_fullsized":"2024-09-21T00:45:46.667185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662605+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:45:46.662605+0000","last_peered":"2024-09-21T00:45:46.662605+0000","last_clean":"2024-09-21T00:45:46.662605+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:45:46.662605+0000","last_undegraded":"2024-09-21T00:45:46.662605+0000","last_fullsized":"2024-09-21T00:45:46.662605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.631611+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:45:46.631611+0000","last_peered":"2024-09-21T00:45:46.631611+0000","last_clean":"2024-09-21T00:45:46.631611+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:45:46.631611+0000","last_undegraded":"2024-09-21T00:45:46.631611+0000","last_fullsized":"2024-09-21T00:45:46.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652940+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:45:46.652940+0000","last_peered":"2024-09-21T00:45:46.652940+0000","last_clean":"2024-09-21T00:45:46.652940+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:45:46.652940+0000","last_undegraded":"2024-09-21T00:45:46.652940+0000","last_fullsized":"2024-09-21T00:45:46.652940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659370+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:45:46.659370+0000","last_peered":"2024-09-21T00:45:46.659370+0000","last_clean":"2024-09-21T00:45:46.659370+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:45:46.659370+0000","last_undegraded":"2024-09-21T00:45:46.659370+0000","last_fullsized":"2024-09-21T00:45:46.659370+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669392+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:45:46.669392+0000","last_peered":"2024-09-21T00:45:46.669392+0000","last_clean":"2024-09-21T00:45:46.669392+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:45:46.669392+0000","last_undegraded":"2024-09-21T00:45:46.669392+0000","last_fullsized":"2024-09-21T00:45:46.669392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667802+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:45:46.667802+0000","last_peered":"2024-09-21T00:45:46.667802+0000","last_clean":"2024-09-21T00:45:46.667802+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:45:46.667802+0000","last_undegraded":"2024-09-21T00:45:46.667802+0000","last_fullsized":"2024-09-21T00:45:46.667802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657145+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:45:46.657145+0000","last_peered":"2024-09-21T00:45:46.657145+0000","last_clean":"2024-09-21T00:45:46.657145+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:45:46.657145+0000","last_undegraded":"2024-09-21T00:45:46.657145+0000","last_fullsized":"2024-09-21T00:45:46.657145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.644918+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:45:46.644918+0000","last_peered":"2024-09-21T00:45:46.644918+0000","last_clean":"2024-09-21T00:45:46.644918+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:45:46.644918+0000","last_undegraded":"2024-09-21T00:45:46.644918+0000","last_fullsized":"2024-09-21T00:45:46.644918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659450+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:45:46.659450+0000","last_peered":"2024-09-21T00:45:46.659450+0000","last_clean":"2024-09-21T00:45:46.659450+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:45:46.659450+0000","last_undegraded":"2024-09-21T00:45:46.659450+0000","last_fullsized":"2024-09-21T00:45:46.659450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639694+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:45:46.639694+0000","last_peered":"2024-09-21T00:45:46.639694+0000","last_clean":"2024-09-21T00:45:46.639694+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:45:46.639694+0000","last_undegraded":"2024-09-21T00:45:46.639694+0000","last_fullsized":"2024-09-21T00:45:46.639694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661110+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:45:46.661110+0000","last_peered":"2024-09-21T00:45:46.661110+0000","last_clean":"2024-09-21T00:45:46.661110+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:45:46.661110+0000","last_undegraded":"2024-09-21T00:45:46.661110+0000","last_fullsized":"2024-09-21T00:45:46.661110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.658982+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:45:46.658982+0000","last_peered":"2024-09-21T00:45:46.658982+0000","last_clean":"2024-09-21T00:45:46.658982+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:45:46.658982+0000","last_undegraded":"2024-09-21T00:45:46.658982+0000","last_fullsized":"2024-09-21T00:45:46.658982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656929+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:45:46.656929+0000","last_peered":"2024-09-21T00:45:46.656929+0000","last_clean":"2024-09-21T00:45:46.656929+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:45:46.656929+0000","last_undegraded":"2024-09-21T00:45:46.656929+0000","last_fullsized":"2024-09-21T00:45:46.656929+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652278+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:45:46.652278+0000","last_peered":"2024-09-21T00:45:46.652278+0000","last_clean":"2024-09-21T00:45:46.652278+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:45:46.652278+0000","last_undegraded":"2024-09-21T00:45:46.652278+0000","last_fullsized":"2024-09-21T00:45:46.652278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.641175+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:45:46.641175+0000","last_peered":"2024-09-21T00:45:46.641175+0000","last_clean":"2024-09-21T00:45:46.641175+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:45:46.641175+0000","last_undegraded":"2024-09-21T00:45:46.641175+0000","last_fullsized":"2024-09-21T00:45:46.641175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661244+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:45:46.661244+0000","last_peered":"2024-09-21T00:45:46.661244+0000","last_clean":"2024-09-21T00:45:46.661244+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:45:46.661244+0000","last_undegraded":"2024-09-21T00:45:46.661244+0000","last_fullsized":"2024-09-21T00:45:46.661244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639445+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:45:46.639445+0000","last_peered":"2024-09-21T00:45:46.639445+0000","last_clean":"2024-09-21T00:45:46.639445+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:45:46.639445+0000","last_undegraded":"2024-09-21T00:45:46.639445+0000","last_fullsized":"2024-09-21T00:45:46.639445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:16.924199+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:46:16.924199+0000","last_peered":"2024-09-21T00:46:16.924199+0000","last_clean":"2024-09-21T00:46:16.924199+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:46:16.924199+0000","last_undegraded":"2024-09-21T00:46:16.924199+0000","last_fullsized":"2024-09-21T00:46:16.924199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660197+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:45:46.660197+0000","last_peered":"2024-09-21T00:45:46.660197+0000","last_clean":"2024-09-21T00:45:46.660197+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:45:46.660197+0000","last_undegraded":"2024-09-21T00:45:46.660197+0000","last_fullsized":"2024-09-21T00:45:46.660197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797980+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:47.797980+0000","last_peered":"2024-09-21T00:44:47.797980+0000","last_clean":"2024-09-21T00:44:47.797980+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:47.797980+0000","last_undegraded":"2024-09-21T00:44:47.797980+0000","last_fullsized":"2024-09-21T00:44:47.797980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799446+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:47.799446+0000","last_peered":"2024-09-21T00:44:47.799446+0000","last_clean":"2024-09-21T00:44:47.799446+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:47.799446+0000","last_undegraded":"2024-09-21T00:44:47.799446+0000","last_fullsized":"2024-09-21T00:44:47.799446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.654634+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:45:46.654634+0000","last_peered":"2024-09-21T00:45:46.654634+0000","last_clean":"2024-09-21T00:45:46.654634+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:45:46.654634+0000","last_undegraded":"2024-09-21T00:45:46.654634+0000","last_fullsized":"2024-09-21T00:45:46.654634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803565+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:47.803565+0000","last_peered":"2024-09-21T00:44:47.803565+0000","last_clean":"2024-09-21T00:44:47.803565+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:47.803565+0000","last_undegraded":"2024-09-21T00:44:47.803565+0000","last_fullsized":"2024-09-21T00:44:47.803565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639907+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:45:46.639907+0000","last_peered":"2024-09-21T00:45:46.639907+0000","last_clean":"2024-09-21T00:45:46.639907+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:45:46.639907+0000","last_undegraded":"2024-09-21T00:45:46.639907+0000","last_fullsized":"2024-09-21T00:45:46.639907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922329+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:46:15.922329+0000","last_peered":"2024-09-21T00:46:15.922329+0000","last_clean":"2024-09-21T00:46:15.922329+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:46:15.922329+0000","last_undegraded":"2024-09-21T00:46:15.922329+0000","last_fullsized":"2024-09-21T00:46:15.922329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664901+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:45:46.664901+0000","last_peered":"2024-09-21T00:45:46.664901+0000","last_clean":"2024-09-21T00:45:46.664901+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:45:46.664901+0000","last_undegraded":"2024-09-21T00:45:46.664901+0000","last_fullsized":"2024-09-21T00:45:46.664901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799157+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:47.799157+0000","last_peered":"2024-09-21T00:44:47.799157+0000","last_clean":"2024-09-21T00:44:47.799157+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:47.799157+0000","last_undegraded":"2024-09-21T00:44:47.799157+0000","last_fullsized":"2024-09-21T00:44:47.799157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656754+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:45:46.656754+0000","last_peered":"2024-09-21T00:45:46.656754+0000","last_clean":"2024-09-21T00:45:46.656754+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:45:46.656754+0000","last_undegraded":"2024-09-21T00:45:46.656754+0000","last_fullsized":"2024-09-21T00:45:46.656754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803641+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:47.803641+0000","last_peered":"2024-09-21T00:44:47.803641+0000","last_clean":"2024-09-21T00:44:47.803641+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:47.803641+0000","last_undegraded":"2024-09-21T00:44:47.803641+0000","last_fullsized":"2024-09-21T00:44:47.803641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662877+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:45:46.662877+0000","last_peered":"2024-09-21T00:45:46.662877+0000","last_clean":"2024-09-21T00:45:46.662877+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:45:46.662877+0000","last_undegraded":"2024-09-21T00:45:46.662877+0000","last_fullsized":"2024-09-21T00:45:46.662877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922109+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:46:15.922109+0000","last_peered":"2024-09-21T00:46:15.922109+0000","last_clean":"2024-09-21T00:46:15.922109+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:46:15.922109+0000","last_undegraded":"2024-09-21T00:46:15.922109+0000","last_fullsized":"2024-09-21T00:46:15.922109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":222,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660825+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:45:46.660825+0000","last_peered":"2024-09-21T00:45:46.660825+0000","last_clean":"2024-09-21T00:45:46.660825+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:45:46.660825+0000","last_undegraded":"2024-09-21T00:45:46.660825+0000","last_fullsized":"2024-09-21T00:45:46.660825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803229+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:47.803229+0000","last_peered":"2024-09-21T00:44:47.803229+0000","last_clean":"2024-09-21T00:44:47.803229+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:47.803229+0000","last_undegraded":"2024-09-21T00:44:47.803229+0000","last_fullsized":"2024-09-21T00:44:47.803229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.666651+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:45:46.666651+0000","last_peered":"2024-09-21T00:45:46.666651+0000","last_clean":"2024-09-21T00:45:46.666651+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:45:46.666651+0000","last_undegraded":"2024-09-21T00:45:46.666651+0000","last_fullsized":"2024-09-21T00:45:46.666651+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803744+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:47.803744+0000","last_peered":"2024-09-21T00:44:47.803744+0000","last_clean":"2024-09-21T00:44:47.803744+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:47.803744+0000","last_undegraded":"2024-09-21T00:44:47.803744+0000","last_fullsized":"2024-09-21T00:44:47.803744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669904+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:45:46.669904+0000","last_peered":"2024-09-21T00:45:46.669904+0000","last_clean":"2024-09-21T00:45:46.669904+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:45:46.669904+0000","last_undegraded":"2024-09-21T00:45:46.669904+0000","last_fullsized":"2024-09-21T00:45:46.669904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.923130+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:46:15.923130+0000","last_peered":"2024-09-21T00:46:15.923130+0000","last_clean":"2024-09-21T00:46:15.923130+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:46:15.923130+0000","last_undegraded":"2024-09-21T00:46:15.923130+0000","last_fullsized":"2024-09-21T00:46:15.923130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665203+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:45:46.665203+0000","last_peered":"2024-09-21T00:45:46.665203+0000","last_clean":"2024-09-21T00:45:46.665203+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:45:46.665203+0000","last_undegraded":"2024-09-21T00:45:46.665203+0000","last_fullsized":"2024-09-21T00:45:46.665203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799995+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:47.799995+0000","last_peered":"2024-09-21T00:44:47.799995+0000","last_clean":"2024-09-21T00:44:47.799995+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:47.799995+0000","last_undegraded":"2024-09-21T00:44:47.799995+0000","last_fullsized":"2024-09-21T00:44:47.799995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.633578+0000","last_change":"2024-09-21T00:44:47.844546+0000","last_active":"2024-09-21T00:45:46.633578+0000","last_peered":"2024-09-21T00:45:46.633578+0000","last_clean":"2024-09-21T00:45:46.633578+0000","last_became_active":"2024-09-21T00:44:47.844212+0000","last_became_peered":"2024-09-21T00:44:47.844212+0000","last_unstale":"2024-09-21T00:45:46.633578+0000","last_undegraded":"2024-09-21T00:45:46.633578+0000","last_fullsized":"2024-09-21T00:45:46.633578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.265217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800471+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:47.800471+0000","last_peered":"2024-09-21T00:44:47.800471+0000","last_clean":"2024-09-21T00:44:47.800471+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:47.800471+0000","last_undegraded":"2024-09-21T00:44:47.800471+0000","last_fullsized":"2024-09-21T00:44:47.800471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660579+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:45:46.660579+0000","last_peered":"2024-09-21T00:45:46.660579+0000","last_clean":"2024-09-21T00:45:46.660579+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:45:46.660579+0000","last_undegraded":"2024-09-21T00:45:46.660579+0000","last_fullsized":"2024-09-21T00:45:46.660579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799596+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:47.799596+0000","last_peered":"2024-09-21T00:44:47.799596+0000","last_clean":"2024-09-21T00:44:47.799596+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:47.799596+0000","last_undegraded":"2024-09-21T00:44:47.799596+0000","last_fullsized":"2024-09-21T00:44:47.799596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665239+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:45:46.665239+0000","last_peered":"2024-09-21T00:45:46.665239+0000","last_clean":"2024-09-21T00:45:46.665239+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:45:46.665239+0000","last_undegraded":"2024-09-21T00:45:46.665239+0000","last_fullsized":"2024-09-21T00:45:46.665239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803777+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:47.803777+0000","last_peered":"2024-09-21T00:44:47.803777+0000","last_clean":"2024-09-21T00:44:47.803777+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:47.803777+0000","last_undegraded":"2024-09-21T00:44:47.803777+0000","last_fullsized":"2024-09-21T00:44:47.803777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664948+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:45:46.664948+0000","last_peered":"2024-09-21T00:45:46.664948+0000","last_clean":"2024-09-21T00:45:46.664948+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:45:46.664948+0000","last_undegraded":"2024-09-21T00:45:46.664948+0000","last_fullsized":"2024-09-21T00:45:46.664948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'7","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.951673+0000","last_change":"2024-09-21T00:44:47.811552+0000","last_active":"2024-09-21T00:46:15.951673+0000","last_peered":"2024-09-21T00:46:15.951673+0000","last_clean":"2024-09-21T00:46:15.951673+0000","last_became_active":"2024-09-21T00:44:47.804091+0000","last_became_peered":"2024-09-21T00:44:47.804091+0000","last_unstale":"2024-09-21T00:46:15.951673+0000","last_undegraded":"2024-09-21T00:46:15.951673+0000","last_fullsized":"2024-09-21T00:46:15.951673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:58.491825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1561,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669130+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:45:46.669130+0000","last_peered":"2024-09-21T00:45:46.669130+0000","last_clean":"2024-09-21T00:45:46.669130+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:45:46.669130+0000","last_undegraded":"2024-09-21T00:45:46.669130+0000","last_fullsized":"2024-09-21T00:45:46.669130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":99,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799301+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:47.799301+0000","last_peered":"2024-09-21T00:44:47.799301+0000","last_clean":"2024-09-21T00:44:47.799301+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:47.799301+0000","last_undegraded":"2024-09-21T00:44:47.799301+0000","last_fullsized":"2024-09-21T00:44:47.799301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800400+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:47.800400+0000","last_peered":"2024-09-21T00:44:47.800400+0000","last_clean":"2024-09-21T00:44:47.800400+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:47.800400+0000","last_undegraded":"2024-09-21T00:44:47.800400+0000","last_fullsized":"2024-09-21T00:44:47.800400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665246+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:45:46.665246+0000","last_peered":"2024-09-21T00:45:46.665246+0000","last_clean":"2024-09-21T00:45:46.665246+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:45:46.665246+0000","last_undegraded":"2024-09-21T00:45:46.665246+0000","last_fullsized":"2024-09-21T00:45:46.665246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.808921+0000","last_change":"2024-09-21T00:44:47.808807+0000","last_active":"2024-09-21T00:44:47.808921+0000","last_peered":"2024-09-21T00:44:47.808921+0000","last_clean":"2024-09-21T00:44:47.808921+0000","last_became_active":"2024-09-21T00:44:47.805581+0000","last_became_peered":"2024-09-21T00:44:47.805581+0000","last_unstale":"2024-09-21T00:44:47.808921+0000","last_undegraded":"2024-09-21T00:44:47.808921+0000","last_fullsized":"2024-09-21T00:44:47.808921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.570140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.646995+0000","last_change":"2024-09-21T00:44:47.804921+0000","last_active":"2024-09-21T00:45:46.646995+0000","last_peered":"2024-09-21T00:45:46.646995+0000","last_clean":"2024-09-21T00:45:46.646995+0000","last_became_active":"2024-09-21T00:44:47.804531+0000","last_became_peered":"2024-09-21T00:44:47.804531+0000","last_unstale":"2024-09-21T00:45:46.646995+0000","last_undegraded":"2024-09-21T00:45:46.646995+0000","last_fullsized":"2024-09-21T00:45:46.646995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:56.462438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:13.918505+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:46:13.918505+0000","last_peered":"2024-09-21T00:46:13.918505+0000","last_clean":"2024-09-21T00:46:13.918505+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:46:13.918505+0000","last_undegraded":"2024-09-21T00:46:13.918505+0000","last_fullsized":"2024-09-21T00:46:13.918505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661217+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:45:46.661217+0000","last_peered":"2024-09-21T00:45:46.661217+0000","last_clean":"2024-09-21T00:45:46.661217+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:45:46.661217+0000","last_undegraded":"2024-09-21T00:45:46.661217+0000","last_fullsized":"2024-09-21T00:45:46.661217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'7","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:12.917527+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:46:12.917527+0000","last_peered":"2024-09-21T00:46:12.917527+0000","last_clean":"2024-09-21T00:46:12.917527+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:46:12.917527+0000","last_undegraded":"2024-09-21T00:46:12.917527+0000","last_fullsized":"2024-09-21T00:46:12.917527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652794+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:45:46.652794+0000","last_peered":"2024-09-21T00:45:46.652794+0000","last_clean":"2024-09-21T00:45:46.652794+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:45:46.652794+0000","last_undegraded":"2024-09-21T00:45:46.652794+0000","last_fullsized":"2024-09-21T00:45:46.652794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796811+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:47.796811+0000","last_peered":"2024-09-21T00:44:47.796811+0000","last_clean":"2024-09-21T00:44:47.796811+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:47.796811+0000","last_undegraded":"2024-09-21T00:44:47.796811+0000","last_fullsized":"2024-09-21T00:44:47.796811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660885+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:45:46.660885+0000","last_peered":"2024-09-21T00:45:46.660885+0000","last_clean":"2024-09-21T00:45:46.660885+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:45:46.660885+0000","last_undegraded":"2024-09-21T00:45:46.660885+0000","last_fullsized":"2024-09-21T00:45:46.660885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800530+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:47.800530+0000","last_peered":"2024-09-21T00:44:47.800530+0000","last_clean":"2024-09-21T00:44:47.800530+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:47.800530+0000","last_undegraded":"2024-09-21T00:44:47.800530+0000","last_fullsized":"2024-09-21T00:44:47.800530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.650572+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:45:46.650572+0000","last_peered":"2024-09-21T00:45:46.650572+0000","last_clean":"2024-09-21T00:45:46.650572+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:45:46.650572+0000","last_undegraded":"2024-09-21T00:45:46.650572+0000","last_fullsized":"2024-09-21T00:45:46.650572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'18","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.698553+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:45:46.698553+0000","last_peered":"2024-09-21T00:45:46.698553+0000","last_clean":"2024-09-21T00:45:46.698553+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:45:46.698553+0000","last_undegraded":"2024-09-21T00:45:46.698553+0000","last_fullsized":"2024-09-21T00:45:46.698553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.663883+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:45:46.663883+0000","last_peered":"2024-09-21T00:45:46.663883+0000","last_clean":"2024-09-21T00:45:46.663883+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:45:46.663883+0000","last_undegraded":"2024-09-21T00:45:46.663883+0000","last_fullsized":"2024-09-21T00:45:46.663883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800939+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:47.800939+0000","last_peered":"2024-09-21T00:44:47.800939+0000","last_clean":"2024-09-21T00:44:47.800939+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:47.800939+0000","last_undegraded":"2024-09-21T00:44:47.800939+0000","last_fullsized":"2024-09-21T00:44:47.800939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657262+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:45:46.657262+0000","last_peered":"2024-09-21T00:45:46.657262+0000","last_clean":"2024-09-21T00:45:46.657262+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:45:46.657262+0000","last_undegraded":"2024-09-21T00:45:46.657262+0000","last_fullsized":"2024-09-21T00:45:46.657262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843924+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:47.843924+0000","last_peered":"2024-09-21T00:44:47.843924+0000","last_clean":"2024-09-21T00:44:47.843924+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:47.843924+0000","last_undegraded":"2024-09-21T00:44:47.843924+0000","last_fullsized":"2024-09-21T00:44:47.843924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.613199+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:45:46.613199+0000","last_peered":"2024-09-21T00:45:46.613199+0000","last_clean":"2024-09-21T00:45:46.613199+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:45:46.613199+0000","last_undegraded":"2024-09-21T00:45:46.613199+0000","last_fullsized":"2024-09-21T00:45:46.613199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800965+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:47.800965+0000","last_peered":"2024-09-21T00:44:47.800965+0000","last_clean":"2024-09-21T00:44:47.800965+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:47.800965+0000","last_undegraded":"2024-09-21T00:44:47.800965+0000","last_fullsized":"2024-09-21T00:44:47.800965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652879+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:45:46.652879+0000","last_peered":"2024-09-21T00:45:46.652879+0000","last_clean":"2024-09-21T00:45:46.652879+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:45:46.652879+0000","last_undegraded":"2024-09-21T00:45:46.652879+0000","last_fullsized":"2024-09-21T00:45:46.652879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803471+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:47.803471+0000","last_peered":"2024-09-21T00:44:47.803471+0000","last_clean":"2024-09-21T00:44:47.803471+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:47.803471+0000","last_undegraded":"2024-09-21T00:44:47.803471+0000","last_fullsized":"2024-09-21T00:44:47.803471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661403+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:45:46.661403+0000","last_peered":"2024-09-21T00:45:46.661403+0000","last_clean":"2024-09-21T00:45:46.661403+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:45:46.661403+0000","last_undegraded":"2024-09-21T00:45:46.661403+0000","last_fullsized":"2024-09-21T00:45:46.661403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800088+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:47.800088+0000","last_peered":"2024-09-21T00:44:47.800088+0000","last_clean":"2024-09-21T00:44:47.800088+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:47.800088+0000","last_undegraded":"2024-09-21T00:44:47.800088+0000","last_fullsized":"2024-09-21T00:44:47.800088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669311+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:45:46.669311+0000","last_peered":"2024-09-21T00:45:46.669311+0000","last_clean":"2024-09-21T00:45:46.669311+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:45:46.669311+0000","last_undegraded":"2024-09-21T00:45:46.669311+0000","last_fullsized":"2024-09-21T00:45:46.669311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660563+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:45:46.660563+0000","last_peered":"2024-09-21T00:45:46.660563+0000","last_clean":"2024-09-21T00:45:46.660563+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:45:46.660563+0000","last_undegraded":"2024-09-21T00:45:46.660563+0000","last_fullsized":"2024-09-21T00:45:46.660563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799986+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:47.799986+0000","last_peered":"2024-09-21T00:44:47.799986+0000","last_clean":"2024-09-21T00:44:47.799986+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:47.799986+0000","last_undegraded":"2024-09-21T00:44:47.799986+0000","last_fullsized":"2024-09-21T00:44:47.799986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664461+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:45:46.664461+0000","last_peered":"2024-09-21T00:45:46.664461+0000","last_clean":"2024-09-21T00:45:46.664461+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:45:46.664461+0000","last_undegraded":"2024-09-21T00:45:46.664461+0000","last_fullsized":"2024-09-21T00:45:46.664461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.862814+0000","last_change":"2024-09-21T00:44:47.862708+0000","last_active":"2024-09-21T00:44:47.862814+0000","last_peered":"2024-09-21T00:44:47.862814+0000","last_clean":"2024-09-21T00:44:47.862814+0000","last_became_active":"2024-09-21T00:44:47.845236+0000","last_became_peered":"2024-09-21T00:44:47.845236+0000","last_unstale":"2024-09-21T00:44:47.862814+0000","last_undegraded":"2024-09-21T00:44:47.862814+0000","last_fullsized":"2024-09-21T00:44:47.862814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:03.770440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665993+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:45:46.665993+0000","last_peered":"2024-09-21T00:45:46.665993+0000","last_clean":"2024-09-21T00:45:46.665993+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:45:46.665993+0000","last_undegraded":"2024-09-21T00:45:46.665993+0000","last_fullsized":"2024-09-21T00:45:46.665993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801639+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:47.801639+0000","last_peered":"2024-09-21T00:44:47.801639+0000","last_clean":"2024-09-21T00:44:47.801639+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:47.801639+0000","last_undegraded":"2024-09-21T00:44:47.801639+0000","last_fullsized":"2024-09-21T00:44:47.801639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657452+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:45:46.657452+0000","last_peered":"2024-09-21T00:45:46.657452+0000","last_clean":"2024-09-21T00:45:46.657452+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:45:46.657452+0000","last_undegraded":"2024-09-21T00:45:46.657452+0000","last_fullsized":"2024-09-21T00:45:46.657452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":144,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:14.919696+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:46:14.919696+0000","last_peered":"2024-09-21T00:46:14.919696+0000","last_clean":"2024-09-21T00:46:14.919696+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:46:14.919696+0000","last_undegraded":"2024-09-21T00:46:14.919696+0000","last_fullsized":"2024-09-21T00:46:14.919696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72785,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1092,"num_read_kb":633,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1561,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":218355,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":400279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1055543,"data_compressed":38165,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":399677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":400055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":993554,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724607,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":399926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920836,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":992392,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084362,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":399219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":464348,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465298,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66743,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65793,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66503,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:46:19.261 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T00:46:19.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:46:19.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.410+0000 7f5c41771640 1 -- 172.21.15.16:0/4005575595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 msgr2=0x7f5c3c103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.410+0000 7f5c41771640 1 --2- 172.21.15.16:0/4005575595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c103a30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009900 tx=0x7f5c2402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.410+0000 7f5c41771640 1 -- 172.21.15.16:0/4005575595 shutdown_connections 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.410+0000 7f5c41771640 1 --2- 172.21.15.16:0/4005575595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.410+0000 7f5c41771640 1 --2- 172.21.15.16:0/4005575595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c103a30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 --2- 172.21.15.16:0/4005575595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- 172.21.15.16:0/4005575595 >> 172.21.15.16:0/4005575595 conn(0x7f5c3c0fdee0 msgr2=0x7f5c3c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- 172.21.15.16:0/4005575595 shutdown_connections 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- 172.21.15.16:0/4005575595 wait complete. 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 Processor -- start 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- start start 2024-09-21T00:46:19.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10e200 con 0x7f5c3c103620 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10e080 con 0x7f5c3c103fc0 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.411+0000 7f5c41771640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10e380 con 0x7f5c3c1025a0 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38522/0 (socket says 172.21.15.16:38522) 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 -- 172.21.15.16:0/3704148123 learned_addr learned my addr 172.21.15.16:0/3704148123 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c3affd640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c3b7fe640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 -- 172.21.15.16:0/3704148123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 msgr2=0x7f5c3c199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 -- 172.21.15.16:0/3704148123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 msgr2=0x7f5c3c19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 -- 172.21.15.16:0/3704148123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c19b960 con 0x7f5c3c103620 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c3affd640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c3b7fe640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c33fff640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006010 tx=0x7f5c24004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2403f030 con 0x7f5c3c103620 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c19bbf0 con 0x7f5c3c103620 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c24003cb0 con 0x7f5c3c103620 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24035070 con 0x7f5c3c103620 2024-09-21T00:46:19.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.412+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c19bf00 con 0x7f5c3c103620 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.413+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c1a23d0 con 0x7f5c3c103620 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.415+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5c24042030 con 0x7f5c3c103620 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.416+0000 7f5c38ff9640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 0x7f5c280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.416+0000 7f5c3affd640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 0x7f5c280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.416+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5c24108110 con 0x7f5c3c103620 2024-09-21T00:46:19.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.416+0000 7f5c3affd640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 0x7f5c280b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0058c0 tx=0x7f5c2c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:19.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.419+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c240ce990 con 0x7f5c3c103620 2024-09-21T00:46:19.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:19 smithi016 ceph-mon[30947]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T00:46:19.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:19 smithi016 ceph-mon[30947]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:19.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.604+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 --> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c3c06bfd0 con 0x7f5c280b6510 2024-09-21T00:46:19.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.608+0000 7f5c38ff9640 1 -- 172.21.15.16:0/3704148123 <== mgr.14152 v2:172.21.15.16:6800/4223283672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259096 (secure 0 0 0) 0x7f5c3c06bfd0 con 0x7f5c280b6510 2024-09-21T00:46:19.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:19.613 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 msgr2=0x7f5c280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 0x7f5c280b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0058c0 tx=0x7f5c2c005850 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 msgr2=0x7f5c3c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006010 tx=0x7f5c24004340 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 shutdown_connections 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5c280b6510 0x7f5c280b8a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c3c103fc0 0x7f5c3c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c3c103620 0x7f5c3c19a590 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 --2- 172.21.15.16:0/3704148123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c3c1025a0 0x7f5c3c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 >> 172.21.15.16:0/3704148123 conn(0x7f5c3c0fdee0 msgr2=0x7f5c3c06b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:19.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 shutdown_connections 2024-09-21T00:46:19.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:19.612+0000 7f5c41771640 1 -- 172.21.15.16:0/3704148123 wait complete. 2024-09-21T00:46:19.624 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-21T00:46:18.286529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663387,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1168,"num_read_kb":697,"num_write":388,"num_write_kb":2307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953401,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380272,"kb_used_data":10224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561552,"statfs":{"total":1151940427776,"available":1151551029248,"internally_reserved":0,"allocated":10469376,"data_stored":6772821,"data_compressed":114495,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":67,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662437+0000","last_change":"2024-09-21T00:44:17.678910+0000","last_active":"2024-09-21T00:45:46.662437+0000","last_peered":"2024-09-21T00:45:46.662437+0000","last_clean":"2024-09-21T00:45:46.662437+0000","last_became_active":"2024-09-21T00:44:17.678447+0000","last_became_peered":"2024-09-21T00:44:17.678447+0000","last_unstale":"2024-09-21T00:45:46.662437+0000","last_undegraded":"2024-09-21T00:45:46.662437+0000","last_fullsized":"2024-09-21T00:45:46.662437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.485193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.647777+0000","last_change":"2024-09-21T00:44:17.684044+0000","last_active":"2024-09-21T00:45:46.647777+0000","last_peered":"2024-09-21T00:45:46.647777+0000","last_clean":"2024-09-21T00:45:46.647777+0000","last_became_active":"2024-09-21T00:44:17.683668+0000","last_became_peered":"2024-09-21T00:44:17.683668+0000","last_unstale":"2024-09-21T00:45:46.647777+0000","last_undegraded":"2024-09-21T00:45:46.647777+0000","last_fullsized":"2024-09-21T00:45:46.647777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:54:46.253198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665670+0000","last_change":"2024-09-21T00:44:17.670910+0000","last_active":"2024-09-21T00:45:46.665670+0000","last_peered":"2024-09-21T00:45:46.665670+0000","last_clean":"2024-09-21T00:45:46.665670+0000","last_became_active":"2024-09-21T00:44:17.670553+0000","last_became_peered":"2024-09-21T00:44:17.670553+0000","last_unstale":"2024-09-21T00:45:46.665670+0000","last_undegraded":"2024-09-21T00:45:46.665670+0000","last_fullsized":"2024-09-21T00:45:46.665670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:53.517065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657179+0000","last_change":"2024-09-21T00:44:17.685180+0000","last_active":"2024-09-21T00:45:46.657179+0000","last_peered":"2024-09-21T00:45:46.657179+0000","last_clean":"2024-09-21T00:45:46.657179+0000","last_became_active":"2024-09-21T00:44:17.684712+0000","last_became_peered":"2024-09-21T00:44:17.684712+0000","last_unstale":"2024-09-21T00:45:46.657179+0000","last_undegraded":"2024-09-21T00:45:46.657179+0000","last_fullsized":"2024-09-21T00:45:46.657179+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:30.809520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.637510+0000","last_change":"2024-09-21T00:44:17.675648+0000","last_active":"2024-09-21T00:45:46.637510+0000","last_peered":"2024-09-21T00:45:46.637510+0000","last_clean":"2024-09-21T00:45:46.637510+0000","last_became_active":"2024-09-21T00:44:17.675258+0000","last_became_peered":"2024-09-21T00:44:17.675258+0000","last_unstale":"2024-09-21T00:45:46.637510+0000","last_undegraded":"2024-09-21T00:45:46.637510+0000","last_fullsized":"2024-09-21T00:45:46.637510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:09.525865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653242+0000","last_change":"2024-09-21T00:44:17.684220+0000","last_active":"2024-09-21T00:45:46.653242+0000","last_peered":"2024-09-21T00:45:46.653242+0000","last_clean":"2024-09-21T00:45:46.653242+0000","last_became_active":"2024-09-21T00:44:17.683862+0000","last_became_peered":"2024-09-21T00:44:17.683862+0000","last_unstale":"2024-09-21T00:45:46.653242+0000","last_undegraded":"2024-09-21T00:45:46.653242+0000","last_fullsized":"2024-09-21T00:45:46.653242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:03.693263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665285+0000","last_change":"2024-09-21T00:44:17.668667+0000","last_active":"2024-09-21T00:45:46.665285+0000","last_peered":"2024-09-21T00:45:46.665285+0000","last_clean":"2024-09-21T00:45:46.665285+0000","last_became_active":"2024-09-21T00:44:17.668230+0000","last_became_peered":"2024-09-21T00:44:17.668230+0000","last_unstale":"2024-09-21T00:45:46.665285+0000","last_undegraded":"2024-09-21T00:45:46.665285+0000","last_fullsized":"2024-09-21T00:45:46.665285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:49:50.385869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662453+0000","last_change":"2024-09-21T00:44:17.678556+0000","last_active":"2024-09-21T00:45:46.662453+0000","last_peered":"2024-09-21T00:45:46.662453+0000","last_clean":"2024-09-21T00:45:46.662453+0000","last_became_active":"2024-09-21T00:44:17.678147+0000","last_became_peered":"2024-09-21T00:44:17.678147+0000","last_unstale":"2024-09-21T00:45:46.662453+0000","last_undegraded":"2024-09-21T00:45:46.662453+0000","last_fullsized":"2024-09-21T00:45:46.662453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:24.136719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664882+0000","last_change":"2024-09-21T00:44:17.684113+0000","last_active":"2024-09-21T00:45:46.664882+0000","last_peered":"2024-09-21T00:45:46.664882+0000","last_clean":"2024-09-21T00:45:46.664882+0000","last_became_active":"2024-09-21T00:44:17.683578+0000","last_became_peered":"2024-09-21T00:44:17.683578+0000","last_unstale":"2024-09-21T00:45:46.664882+0000","last_undegraded":"2024-09-21T00:45:46.664882+0000","last_fullsized":"2024-09-21T00:45:46.664882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:29:29.331075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.655531+0000","last_change":"2024-09-21T00:44:47.805103+0000","last_active":"2024-09-21T00:45:46.655531+0000","last_peered":"2024-09-21T00:45:46.655531+0000","last_clean":"2024-09-21T00:45:46.655531+0000","last_became_active":"2024-09-21T00:44:47.804708+0000","last_became_peered":"2024-09-21T00:44:47.804708+0000","last_unstale":"2024-09-21T00:45:46.655531+0000","last_undegraded":"2024-09-21T00:45:46.655531+0000","last_fullsized":"2024-09-21T00:45:46.655531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:18.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.668994+0000","last_change":"2024-09-21T00:44:17.673964+0000","last_active":"2024-09-21T00:45:46.668994+0000","last_peered":"2024-09-21T00:45:46.668994+0000","last_clean":"2024-09-21T00:45:46.668994+0000","last_became_active":"2024-09-21T00:44:17.673531+0000","last_became_peered":"2024-09-21T00:44:17.673531+0000","last_unstale":"2024-09-21T00:45:46.668994+0000","last_undegraded":"2024-09-21T00:45:46.668994+0000","last_fullsized":"2024-09-21T00:45:46.668994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:15.544401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656611+0000","last_change":"2024-09-21T00:44:17.684080+0000","last_active":"2024-09-21T00:45:46.656611+0000","last_peered":"2024-09-21T00:45:46.656611+0000","last_clean":"2024-09-21T00:45:46.656611+0000","last_became_active":"2024-09-21T00:44:17.682578+0000","last_became_peered":"2024-09-21T00:44:17.682578+0000","last_unstale":"2024-09-21T00:45:46.656611+0000","last_undegraded":"2024-09-21T00:45:46.656611+0000","last_fullsized":"2024-09-21T00:45:46.656611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656622+0000","last_change":"2024-09-21T00:44:17.667300+0000","last_active":"2024-09-21T00:45:46.656622+0000","last_peered":"2024-09-21T00:45:46.656622+0000","last_clean":"2024-09-21T00:45:46.656622+0000","last_became_active":"2024-09-21T00:44:17.666958+0000","last_became_peered":"2024-09-21T00:44:17.666958+0000","last_unstale":"2024-09-21T00:45:46.656622+0000","last_undegraded":"2024-09-21T00:45:46.656622+0000","last_fullsized":"2024-09-21T00:45:46.656622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:13.784793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.653444+0000","last_change":"2024-09-21T00:44:17.672098+0000","last_active":"2024-09-21T00:45:46.653444+0000","last_peered":"2024-09-21T00:45:46.653444+0000","last_clean":"2024-09-21T00:45:46.653444+0000","last_became_active":"2024-09-21T00:44:17.671422+0000","last_became_peered":"2024-09-21T00:44:17.671422+0000","last_unstale":"2024-09-21T00:45:46.653444+0000","last_undegraded":"2024-09-21T00:45:46.653444+0000","last_fullsized":"2024-09-21T00:45:46.653444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:12.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656861+0000","last_change":"2024-09-21T00:44:17.686045+0000","last_active":"2024-09-21T00:45:46.656861+0000","last_peered":"2024-09-21T00:45:46.656861+0000","last_clean":"2024-09-21T00:45:46.656861+0000","last_became_active":"2024-09-21T00:44:17.685735+0000","last_became_peered":"2024-09-21T00:44:17.685735+0000","last_unstale":"2024-09-21T00:45:46.656861+0000","last_undegraded":"2024-09-21T00:45:46.656861+0000","last_fullsized":"2024-09-21T00:45:46.656861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:32.372779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667185+0000","last_change":"2024-09-21T00:44:17.676353+0000","last_active":"2024-09-21T00:45:46.667185+0000","last_peered":"2024-09-21T00:45:46.667185+0000","last_clean":"2024-09-21T00:45:46.667185+0000","last_became_active":"2024-09-21T00:44:17.675506+0000","last_became_peered":"2024-09-21T00:44:17.675506+0000","last_unstale":"2024-09-21T00:45:46.667185+0000","last_undegraded":"2024-09-21T00:45:46.667185+0000","last_fullsized":"2024-09-21T00:45:46.667185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:26.022410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662605+0000","last_change":"2024-09-21T00:44:17.680002+0000","last_active":"2024-09-21T00:45:46.662605+0000","last_peered":"2024-09-21T00:45:46.662605+0000","last_clean":"2024-09-21T00:45:46.662605+0000","last_became_active":"2024-09-21T00:44:17.679623+0000","last_became_peered":"2024-09-21T00:44:17.679623+0000","last_unstale":"2024-09-21T00:45:46.662605+0000","last_undegraded":"2024-09-21T00:45:46.662605+0000","last_fullsized":"2024-09-21T00:45:46.662605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:47.741895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.631611+0000","last_change":"2024-09-21T00:44:17.678231+0000","last_active":"2024-09-21T00:45:46.631611+0000","last_peered":"2024-09-21T00:45:46.631611+0000","last_clean":"2024-09-21T00:45:46.631611+0000","last_became_active":"2024-09-21T00:44:17.677878+0000","last_became_peered":"2024-09-21T00:44:17.677878+0000","last_unstale":"2024-09-21T00:45:46.631611+0000","last_undegraded":"2024-09-21T00:45:46.631611+0000","last_fullsized":"2024-09-21T00:45:46.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:40.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652940+0000","last_change":"2024-09-21T00:44:17.674202+0000","last_active":"2024-09-21T00:45:46.652940+0000","last_peered":"2024-09-21T00:45:46.652940+0000","last_clean":"2024-09-21T00:45:46.652940+0000","last_became_active":"2024-09-21T00:44:17.673279+0000","last_became_peered":"2024-09-21T00:44:17.673279+0000","last_unstale":"2024-09-21T00:45:46.652940+0000","last_undegraded":"2024-09-21T00:45:46.652940+0000","last_fullsized":"2024-09-21T00:45:46.652940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:34.904413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659370+0000","last_change":"2024-09-21T00:44:17.688707+0000","last_active":"2024-09-21T00:45:46.659370+0000","last_peered":"2024-09-21T00:45:46.659370+0000","last_clean":"2024-09-21T00:45:46.659370+0000","last_became_active":"2024-09-21T00:44:17.688306+0000","last_became_peered":"2024-09-21T00:44:17.688306+0000","last_unstale":"2024-09-21T00:45:46.659370+0000","last_undegraded":"2024-09-21T00:45:46.659370+0000","last_fullsized":"2024-09-21T00:45:46.659370+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:10:23.003859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669392+0000","last_change":"2024-09-21T00:44:17.666463+0000","last_active":"2024-09-21T00:45:46.669392+0000","last_peered":"2024-09-21T00:45:46.669392+0000","last_clean":"2024-09-21T00:45:46.669392+0000","last_became_active":"2024-09-21T00:44:17.666112+0000","last_became_peered":"2024-09-21T00:44:17.666112+0000","last_unstale":"2024-09-21T00:45:46.669392+0000","last_undegraded":"2024-09-21T00:45:46.669392+0000","last_fullsized":"2024-09-21T00:45:46.669392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:31.748108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.667802+0000","last_change":"2024-09-21T00:44:17.681309+0000","last_active":"2024-09-21T00:45:46.667802+0000","last_peered":"2024-09-21T00:45:46.667802+0000","last_clean":"2024-09-21T00:45:46.667802+0000","last_became_active":"2024-09-21T00:44:17.680574+0000","last_became_peered":"2024-09-21T00:44:17.680574+0000","last_unstale":"2024-09-21T00:45:46.667802+0000","last_undegraded":"2024-09-21T00:45:46.667802+0000","last_fullsized":"2024-09-21T00:45:46.667802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:54.013553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657145+0000","last_change":"2024-09-21T00:44:17.682541+0000","last_active":"2024-09-21T00:45:46.657145+0000","last_peered":"2024-09-21T00:45:46.657145+0000","last_clean":"2024-09-21T00:45:46.657145+0000","last_became_active":"2024-09-21T00:44:17.682174+0000","last_became_peered":"2024-09-21T00:44:17.682174+0000","last_unstale":"2024-09-21T00:45:46.657145+0000","last_undegraded":"2024-09-21T00:45:46.657145+0000","last_fullsized":"2024-09-21T00:45:46.657145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:30.419814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.644918+0000","last_change":"2024-09-21T00:44:17.669803+0000","last_active":"2024-09-21T00:45:46.644918+0000","last_peered":"2024-09-21T00:45:46.644918+0000","last_clean":"2024-09-21T00:45:46.644918+0000","last_became_active":"2024-09-21T00:44:17.669407+0000","last_became_peered":"2024-09-21T00:44:17.669407+0000","last_unstale":"2024-09-21T00:45:46.644918+0000","last_undegraded":"2024-09-21T00:45:46.644918+0000","last_fullsized":"2024-09-21T00:45:46.644918+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:04.503988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.659450+0000","last_change":"2024-09-21T00:44:17.680876+0000","last_active":"2024-09-21T00:45:46.659450+0000","last_peered":"2024-09-21T00:45:46.659450+0000","last_clean":"2024-09-21T00:45:46.659450+0000","last_became_active":"2024-09-21T00:44:17.680501+0000","last_became_peered":"2024-09-21T00:44:17.680501+0000","last_unstale":"2024-09-21T00:45:46.659450+0000","last_undegraded":"2024-09-21T00:45:46.659450+0000","last_fullsized":"2024-09-21T00:45:46.659450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:05.783866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639694+0000","last_change":"2024-09-21T00:44:17.674287+0000","last_active":"2024-09-21T00:45:46.639694+0000","last_peered":"2024-09-21T00:45:46.639694+0000","last_clean":"2024-09-21T00:45:46.639694+0000","last_became_active":"2024-09-21T00:44:17.673865+0000","last_became_peered":"2024-09-21T00:44:17.673865+0000","last_unstale":"2024-09-21T00:45:46.639694+0000","last_undegraded":"2024-09-21T00:45:46.639694+0000","last_fullsized":"2024-09-21T00:45:46.639694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.091556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661110+0000","last_change":"2024-09-21T00:44:17.684035+0000","last_active":"2024-09-21T00:45:46.661110+0000","last_peered":"2024-09-21T00:45:46.661110+0000","last_clean":"2024-09-21T00:45:46.661110+0000","last_became_active":"2024-09-21T00:44:17.683655+0000","last_became_peered":"2024-09-21T00:44:17.683655+0000","last_unstale":"2024-09-21T00:45:46.661110+0000","last_undegraded":"2024-09-21T00:45:46.661110+0000","last_fullsized":"2024-09-21T00:45:46.661110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:07:34.573270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.658982+0000","last_change":"2024-09-21T00:44:17.680215+0000","last_active":"2024-09-21T00:45:46.658982+0000","last_peered":"2024-09-21T00:45:46.658982+0000","last_clean":"2024-09-21T00:45:46.658982+0000","last_became_active":"2024-09-21T00:44:17.679834+0000","last_became_peered":"2024-09-21T00:44:17.679834+0000","last_unstale":"2024-09-21T00:45:46.658982+0000","last_undegraded":"2024-09-21T00:45:46.658982+0000","last_fullsized":"2024-09-21T00:45:46.658982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:06.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656929+0000","last_change":"2024-09-21T00:44:17.681315+0000","last_active":"2024-09-21T00:45:46.656929+0000","last_peered":"2024-09-21T00:45:46.656929+0000","last_clean":"2024-09-21T00:45:46.656929+0000","last_became_active":"2024-09-21T00:44:17.680794+0000","last_became_peered":"2024-09-21T00:44:17.680794+0000","last_unstale":"2024-09-21T00:45:46.656929+0000","last_undegraded":"2024-09-21T00:45:46.656929+0000","last_fullsized":"2024-09-21T00:45:46.656929+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:58.384759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652278+0000","last_change":"2024-09-21T00:44:17.672611+0000","last_active":"2024-09-21T00:45:46.652278+0000","last_peered":"2024-09-21T00:45:46.652278+0000","last_clean":"2024-09-21T00:45:46.652278+0000","last_became_active":"2024-09-21T00:44:17.672208+0000","last_became_peered":"2024-09-21T00:44:17.672208+0000","last_unstale":"2024-09-21T00:45:46.652278+0000","last_undegraded":"2024-09-21T00:45:46.652278+0000","last_fullsized":"2024-09-21T00:45:46.652278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:48.155268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.641175+0000","last_change":"2024-09-21T00:44:17.678736+0000","last_active":"2024-09-21T00:45:46.641175+0000","last_peered":"2024-09-21T00:45:46.641175+0000","last_clean":"2024-09-21T00:45:46.641175+0000","last_became_active":"2024-09-21T00:44:17.678143+0000","last_became_peered":"2024-09-21T00:44:17.678143+0000","last_unstale":"2024-09-21T00:45:46.641175+0000","last_undegraded":"2024-09-21T00:45:46.641175+0000","last_fullsized":"2024-09-21T00:45:46.641175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:49.204193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661244+0000","last_change":"2024-09-21T00:44:17.683616+0000","last_active":"2024-09-21T00:45:46.661244+0000","last_peered":"2024-09-21T00:45:46.661244+0000","last_clean":"2024-09-21T00:45:46.661244+0000","last_became_active":"2024-09-21T00:44:17.683219+0000","last_became_peered":"2024-09-21T00:44:17.683219+0000","last_unstale":"2024-09-21T00:45:46.661244+0000","last_undegraded":"2024-09-21T00:45:46.661244+0000","last_fullsized":"2024-09-21T00:45:46.661244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:08.384299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639445+0000","last_change":"2024-09-21T00:44:17.676702+0000","last_active":"2024-09-21T00:45:46.639445+0000","last_peered":"2024-09-21T00:45:46.639445+0000","last_clean":"2024-09-21T00:45:46.639445+0000","last_became_active":"2024-09-21T00:44:17.676317+0000","last_became_peered":"2024-09-21T00:44:17.676317+0000","last_unstale":"2024-09-21T00:45:46.639445+0000","last_undegraded":"2024-09-21T00:45:46.639445+0000","last_fullsized":"2024-09-21T00:45:46.639445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:46.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:16.924199+0000","last_change":"2024-09-21T00:44:15.659365+0000","last_active":"2024-09-21T00:46:16.924199+0000","last_peered":"2024-09-21T00:46:16.924199+0000","last_clean":"2024-09-21T00:46:16.924199+0000","last_became_active":"2024-09-21T00:44:15.658937+0000","last_became_peered":"2024-09-21T00:44:15.658937+0000","last_unstale":"2024-09-21T00:46:16.924199+0000","last_undegraded":"2024-09-21T00:46:16.924199+0000","last_fullsized":"2024-09-21T00:46:16.924199+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:14.656403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660197+0000","last_change":"2024-09-21T00:44:17.684133+0000","last_active":"2024-09-21T00:45:46.660197+0000","last_peered":"2024-09-21T00:45:46.660197+0000","last_clean":"2024-09-21T00:45:46.660197+0000","last_became_active":"2024-09-21T00:44:17.683021+0000","last_became_peered":"2024-09-21T00:44:17.683021+0000","last_unstale":"2024-09-21T00:45:46.660197+0000","last_undegraded":"2024-09-21T00:45:46.660197+0000","last_fullsized":"2024-09-21T00:45:46.660197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:44.849697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.797980+0000","last_change":"2024-09-21T00:44:15.660020+0000","last_active":"2024-09-21T00:44:47.797980+0000","last_peered":"2024-09-21T00:44:47.797980+0000","last_clean":"2024-09-21T00:44:47.797980+0000","last_became_active":"2024-09-21T00:44:15.659079+0000","last_became_peered":"2024-09-21T00:44:15.659079+0000","last_unstale":"2024-09-21T00:44:47.797980+0000","last_undegraded":"2024-09-21T00:44:47.797980+0000","last_fullsized":"2024-09-21T00:44:47.797980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:05.294280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799446+0000","last_change":"2024-09-21T00:44:15.658936+0000","last_active":"2024-09-21T00:44:47.799446+0000","last_peered":"2024-09-21T00:44:47.799446+0000","last_clean":"2024-09-21T00:44:47.799446+0000","last_became_active":"2024-09-21T00:44:15.658532+0000","last_became_peered":"2024-09-21T00:44:15.658532+0000","last_unstale":"2024-09-21T00:44:47.799446+0000","last_undegraded":"2024-09-21T00:44:47.799446+0000","last_fullsized":"2024-09-21T00:44:47.799446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:25.467548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.654634+0000","last_change":"2024-09-21T00:44:17.676188+0000","last_active":"2024-09-21T00:45:46.654634+0000","last_peered":"2024-09-21T00:45:46.654634+0000","last_clean":"2024-09-21T00:45:46.654634+0000","last_became_active":"2024-09-21T00:44:17.675653+0000","last_became_peered":"2024-09-21T00:44:17.675653+0000","last_unstale":"2024-09-21T00:45:46.654634+0000","last_undegraded":"2024-09-21T00:45:46.654634+0000","last_fullsized":"2024-09-21T00:45:46.654634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.928252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803565+0000","last_change":"2024-09-21T00:44:15.660095+0000","last_active":"2024-09-21T00:44:47.803565+0000","last_peered":"2024-09-21T00:44:47.803565+0000","last_clean":"2024-09-21T00:44:47.803565+0000","last_became_active":"2024-09-21T00:44:15.659716+0000","last_became_peered":"2024-09-21T00:44:15.659716+0000","last_unstale":"2024-09-21T00:44:47.803565+0000","last_undegraded":"2024-09-21T00:44:47.803565+0000","last_fullsized":"2024-09-21T00:44:47.803565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:38.389000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.639907+0000","last_change":"2024-09-21T00:44:17.679189+0000","last_active":"2024-09-21T00:45:46.639907+0000","last_peered":"2024-09-21T00:45:46.639907+0000","last_clean":"2024-09-21T00:45:46.639907+0000","last_became_active":"2024-09-21T00:44:17.678800+0000","last_became_peered":"2024-09-21T00:44:17.678800+0000","last_unstale":"2024-09-21T00:45:46.639907+0000","last_undegraded":"2024-09-21T00:45:46.639907+0000","last_fullsized":"2024-09-21T00:45:46.639907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:30.929063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'6","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922329+0000","last_change":"2024-09-21T00:44:15.663515+0000","last_active":"2024-09-21T00:46:15.922329+0000","last_peered":"2024-09-21T00:46:15.922329+0000","last_clean":"2024-09-21T00:46:15.922329+0000","last_became_active":"2024-09-21T00:44:15.663026+0000","last_became_peered":"2024-09-21T00:44:15.663026+0000","last_unstale":"2024-09-21T00:46:15.922329+0000","last_undegraded":"2024-09-21T00:46:15.922329+0000","last_fullsized":"2024-09-21T00:46:15.922329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664901+0000","last_change":"2024-09-21T00:44:17.685932+0000","last_active":"2024-09-21T00:45:46.664901+0000","last_peered":"2024-09-21T00:45:46.664901+0000","last_clean":"2024-09-21T00:45:46.664901+0000","last_became_active":"2024-09-21T00:44:17.685269+0000","last_became_peered":"2024-09-21T00:44:17.685269+0000","last_unstale":"2024-09-21T00:45:46.664901+0000","last_undegraded":"2024-09-21T00:45:46.664901+0000","last_fullsized":"2024-09-21T00:45:46.664901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:07.746879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799157+0000","last_change":"2024-09-21T00:44:15.660084+0000","last_active":"2024-09-21T00:44:47.799157+0000","last_peered":"2024-09-21T00:44:47.799157+0000","last_clean":"2024-09-21T00:44:47.799157+0000","last_became_active":"2024-09-21T00:44:15.659406+0000","last_became_peered":"2024-09-21T00:44:15.659406+0000","last_unstale":"2024-09-21T00:44:47.799157+0000","last_undegraded":"2024-09-21T00:44:47.799157+0000","last_fullsized":"2024-09-21T00:44:47.799157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:47.524156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.656754+0000","last_change":"2024-09-21T00:44:17.680450+0000","last_active":"2024-09-21T00:45:46.656754+0000","last_peered":"2024-09-21T00:45:46.656754+0000","last_clean":"2024-09-21T00:45:46.656754+0000","last_became_active":"2024-09-21T00:44:17.680088+0000","last_became_peered":"2024-09-21T00:44:17.680088+0000","last_unstale":"2024-09-21T00:45:46.656754+0000","last_undegraded":"2024-09-21T00:45:46.656754+0000","last_fullsized":"2024-09-21T00:45:46.656754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:49.151900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803641+0000","last_change":"2024-09-21T00:44:15.673341+0000","last_active":"2024-09-21T00:44:47.803641+0000","last_peered":"2024-09-21T00:44:47.803641+0000","last_clean":"2024-09-21T00:44:47.803641+0000","last_became_active":"2024-09-21T00:44:15.672964+0000","last_became_peered":"2024-09-21T00:44:15.672964+0000","last_unstale":"2024-09-21T00:44:47.803641+0000","last_undegraded":"2024-09-21T00:44:47.803641+0000","last_fullsized":"2024-09-21T00:44:47.803641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:15.895351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.662877+0000","last_change":"2024-09-21T00:44:17.683239+0000","last_active":"2024-09-21T00:45:46.662877+0000","last_peered":"2024-09-21T00:45:46.662877+0000","last_clean":"2024-09-21T00:45:46.662877+0000","last_became_active":"2024-09-21T00:44:17.682480+0000","last_became_peered":"2024-09-21T00:44:17.682480+0000","last_unstale":"2024-09-21T00:45:46.662877+0000","last_undegraded":"2024-09-21T00:45:46.662877+0000","last_fullsized":"2024-09-21T00:45:46.662877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:52.826630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.922109+0000","last_change":"2024-09-21T00:44:15.661398+0000","last_active":"2024-09-21T00:46:15.922109+0000","last_peered":"2024-09-21T00:46:15.922109+0000","last_clean":"2024-09-21T00:46:15.922109+0000","last_became_active":"2024-09-21T00:44:15.660982+0000","last_became_peered":"2024-09-21T00:44:15.660982+0000","last_unstale":"2024-09-21T00:46:15.922109+0000","last_undegraded":"2024-09-21T00:46:15.922109+0000","last_fullsized":"2024-09-21T00:46:15.922109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:07.478936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":222,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660825+0000","last_change":"2024-09-21T00:44:17.683363+0000","last_active":"2024-09-21T00:45:46.660825+0000","last_peered":"2024-09-21T00:45:46.660825+0000","last_clean":"2024-09-21T00:45:46.660825+0000","last_became_active":"2024-09-21T00:44:17.682961+0000","last_became_peered":"2024-09-21T00:44:17.682961+0000","last_unstale":"2024-09-21T00:45:46.660825+0000","last_undegraded":"2024-09-21T00:45:46.660825+0000","last_fullsized":"2024-09-21T00:45:46.660825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:36.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803229+0000","last_change":"2024-09-21T00:44:15.661076+0000","last_active":"2024-09-21T00:44:47.803229+0000","last_peered":"2024-09-21T00:44:47.803229+0000","last_clean":"2024-09-21T00:44:47.803229+0000","last_became_active":"2024-09-21T00:44:15.660676+0000","last_became_peered":"2024-09-21T00:44:15.660676+0000","last_unstale":"2024-09-21T00:44:47.803229+0000","last_undegraded":"2024-09-21T00:44:47.803229+0000","last_fullsized":"2024-09-21T00:44:47.803229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:40.821797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.666651+0000","last_change":"2024-09-21T00:44:17.672281+0000","last_active":"2024-09-21T00:45:46.666651+0000","last_peered":"2024-09-21T00:45:46.666651+0000","last_clean":"2024-09-21T00:45:46.666651+0000","last_became_active":"2024-09-21T00:44:17.671564+0000","last_became_peered":"2024-09-21T00:44:17.671564+0000","last_unstale":"2024-09-21T00:45:46.666651+0000","last_undegraded":"2024-09-21T00:45:46.666651+0000","last_fullsized":"2024-09-21T00:45:46.666651+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:27.546108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803744+0000","last_change":"2024-09-21T00:44:15.659413+0000","last_active":"2024-09-21T00:44:47.803744+0000","last_peered":"2024-09-21T00:44:47.803744+0000","last_clean":"2024-09-21T00:44:47.803744+0000","last_became_active":"2024-09-21T00:44:15.658980+0000","last_became_peered":"2024-09-21T00:44:15.658980+0000","last_unstale":"2024-09-21T00:44:47.803744+0000","last_undegraded":"2024-09-21T00:44:47.803744+0000","last_fullsized":"2024-09-21T00:44:47.803744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:27.744038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669904+0000","last_change":"2024-09-21T00:44:17.679546+0000","last_active":"2024-09-21T00:45:46.669904+0000","last_peered":"2024-09-21T00:45:46.669904+0000","last_clean":"2024-09-21T00:45:46.669904+0000","last_became_active":"2024-09-21T00:44:17.679160+0000","last_became_peered":"2024-09-21T00:44:17.679160+0000","last_unstale":"2024-09-21T00:45:46.669904+0000","last_undegraded":"2024-09-21T00:45:46.669904+0000","last_fullsized":"2024-09-21T00:45:46.669904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:33.885141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":139,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.923130+0000","last_change":"2024-09-21T00:44:15.662296+0000","last_active":"2024-09-21T00:46:15.923130+0000","last_peered":"2024-09-21T00:46:15.923130+0000","last_clean":"2024-09-21T00:46:15.923130+0000","last_became_active":"2024-09-21T00:44:15.661922+0000","last_became_peered":"2024-09-21T00:44:15.661922+0000","last_unstale":"2024-09-21T00:46:15.923130+0000","last_undegraded":"2024-09-21T00:46:15.923130+0000","last_fullsized":"2024-09-21T00:46:15.923130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:28.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665203+0000","last_change":"2024-09-21T00:44:17.673806+0000","last_active":"2024-09-21T00:45:46.665203+0000","last_peered":"2024-09-21T00:45:46.665203+0000","last_clean":"2024-09-21T00:45:46.665203+0000","last_became_active":"2024-09-21T00:44:17.673427+0000","last_became_peered":"2024-09-21T00:44:17.673427+0000","last_unstale":"2024-09-21T00:45:46.665203+0000","last_undegraded":"2024-09-21T00:45:46.665203+0000","last_fullsized":"2024-09-21T00:45:46.665203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:01.775226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799995+0000","last_change":"2024-09-21T00:44:15.673677+0000","last_active":"2024-09-21T00:44:47.799995+0000","last_peered":"2024-09-21T00:44:47.799995+0000","last_clean":"2024-09-21T00:44:47.799995+0000","last_became_active":"2024-09-21T00:44:15.672985+0000","last_became_peered":"2024-09-21T00:44:15.672985+0000","last_unstale":"2024-09-21T00:44:47.799995+0000","last_undegraded":"2024-09-21T00:44:47.799995+0000","last_fullsized":"2024-09-21T00:44:47.799995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:41.395124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.633578+0000","last_change":"2024-09-21T00:44:47.844546+0000","last_active":"2024-09-21T00:45:46.633578+0000","last_peered":"2024-09-21T00:45:46.633578+0000","last_clean":"2024-09-21T00:45:46.633578+0000","last_became_active":"2024-09-21T00:44:47.844212+0000","last_became_peered":"2024-09-21T00:44:47.844212+0000","last_unstale":"2024-09-21T00:45:46.633578+0000","last_undegraded":"2024-09-21T00:45:46.633578+0000","last_fullsized":"2024-09-21T00:45:46.633578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.265217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800471+0000","last_change":"2024-09-21T00:44:15.665074+0000","last_active":"2024-09-21T00:44:47.800471+0000","last_peered":"2024-09-21T00:44:47.800471+0000","last_clean":"2024-09-21T00:44:47.800471+0000","last_became_active":"2024-09-21T00:44:15.664640+0000","last_became_peered":"2024-09-21T00:44:15.664640+0000","last_unstale":"2024-09-21T00:44:47.800471+0000","last_undegraded":"2024-09-21T00:44:47.800471+0000","last_fullsized":"2024-09-21T00:44:47.800471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:33.549439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660579+0000","last_change":"2024-09-21T00:44:17.688648+0000","last_active":"2024-09-21T00:45:46.660579+0000","last_peered":"2024-09-21T00:45:46.660579+0000","last_clean":"2024-09-21T00:45:46.660579+0000","last_became_active":"2024-09-21T00:44:17.688243+0000","last_became_peered":"2024-09-21T00:44:17.688243+0000","last_unstale":"2024-09-21T00:45:46.660579+0000","last_undegraded":"2024-09-21T00:45:46.660579+0000","last_fullsized":"2024-09-21T00:45:46.660579+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:31.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799596+0000","last_change":"2024-09-21T00:44:15.655215+0000","last_active":"2024-09-21T00:44:47.799596+0000","last_peered":"2024-09-21T00:44:47.799596+0000","last_clean":"2024-09-21T00:44:47.799596+0000","last_became_active":"2024-09-21T00:44:15.654830+0000","last_became_peered":"2024-09-21T00:44:15.654830+0000","last_unstale":"2024-09-21T00:44:47.799596+0000","last_undegraded":"2024-09-21T00:44:47.799596+0000","last_fullsized":"2024-09-21T00:44:47.799596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:59.466586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665239+0000","last_change":"2024-09-21T00:44:17.678586+0000","last_active":"2024-09-21T00:45:46.665239+0000","last_peered":"2024-09-21T00:45:46.665239+0000","last_clean":"2024-09-21T00:45:46.665239+0000","last_became_active":"2024-09-21T00:44:17.677975+0000","last_became_peered":"2024-09-21T00:44:17.677975+0000","last_unstale":"2024-09-21T00:45:46.665239+0000","last_undegraded":"2024-09-21T00:45:46.665239+0000","last_fullsized":"2024-09-21T00:45:46.665239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:16.391953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803777+0000","last_change":"2024-09-21T00:44:15.659725+0000","last_active":"2024-09-21T00:44:47.803777+0000","last_peered":"2024-09-21T00:44:47.803777+0000","last_clean":"2024-09-21T00:44:47.803777+0000","last_became_active":"2024-09-21T00:44:15.659265+0000","last_became_peered":"2024-09-21T00:44:15.659265+0000","last_unstale":"2024-09-21T00:44:47.803777+0000","last_undegraded":"2024-09-21T00:44:47.803777+0000","last_fullsized":"2024-09-21T00:44:47.803777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:52.028772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664948+0000","last_change":"2024-09-21T00:44:17.671022+0000","last_active":"2024-09-21T00:45:46.664948+0000","last_peered":"2024-09-21T00:45:46.664948+0000","last_clean":"2024-09-21T00:45:46.664948+0000","last_became_active":"2024-09-21T00:44:17.669988+0000","last_became_peered":"2024-09-21T00:44:17.669988+0000","last_unstale":"2024-09-21T00:45:46.664948+0000","last_undegraded":"2024-09-21T00:45:46.664948+0000","last_fullsized":"2024-09-21T00:45:46.664948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:41.589749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'7","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:15.951673+0000","last_change":"2024-09-21T00:44:47.811552+0000","last_active":"2024-09-21T00:46:15.951673+0000","last_peered":"2024-09-21T00:46:15.951673+0000","last_clean":"2024-09-21T00:46:15.951673+0000","last_became_active":"2024-09-21T00:44:47.804091+0000","last_became_peered":"2024-09-21T00:44:47.804091+0000","last_unstale":"2024-09-21T00:46:15.951673+0000","last_undegraded":"2024-09-21T00:46:15.951673+0000","last_fullsized":"2024-09-21T00:46:15.951673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:58.491825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1561,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669130+0000","last_change":"2024-09-21T00:44:17.677407+0000","last_active":"2024-09-21T00:45:46.669130+0000","last_peered":"2024-09-21T00:45:46.669130+0000","last_clean":"2024-09-21T00:45:46.669130+0000","last_became_active":"2024-09-21T00:44:17.677043+0000","last_became_peered":"2024-09-21T00:44:17.677043+0000","last_unstale":"2024-09-21T00:45:46.669130+0000","last_undegraded":"2024-09-21T00:45:46.669130+0000","last_fullsized":"2024-09-21T00:45:46.669130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:51.006511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":99,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799301+0000","last_change":"2024-09-21T00:43:03.986207+0000","last_active":"2024-09-21T00:44:47.799301+0000","last_peered":"2024-09-21T00:44:47.799301+0000","last_clean":"2024-09-21T00:44:47.799301+0000","last_became_active":"2024-09-21T00:43:03.908966+0000","last_became_peered":"2024-09-21T00:43:03.908966+0000","last_unstale":"2024-09-21T00:44:47.799301+0000","last_undegraded":"2024-09-21T00:44:47.799301+0000","last_fullsized":"2024-09-21T00:44:47.799301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:39:36.833048+0000","last_clean_scrub_stamp":"2024-09-21T00:39:36.833048+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:17.672275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800400+0000","last_change":"2024-09-21T00:44:15.664663+0000","last_active":"2024-09-21T00:44:47.800400+0000","last_peered":"2024-09-21T00:44:47.800400+0000","last_clean":"2024-09-21T00:44:47.800400+0000","last_became_active":"2024-09-21T00:44:15.664216+0000","last_became_peered":"2024-09-21T00:44:15.664216+0000","last_unstale":"2024-09-21T00:44:47.800400+0000","last_undegraded":"2024-09-21T00:44:47.800400+0000","last_fullsized":"2024-09-21T00:44:47.800400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:54.494345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665246+0000","last_change":"2024-09-21T00:44:17.674450+0000","last_active":"2024-09-21T00:45:46.665246+0000","last_peered":"2024-09-21T00:45:46.665246+0000","last_clean":"2024-09-21T00:45:46.665246+0000","last_became_active":"2024-09-21T00:44:17.674120+0000","last_became_peered":"2024-09-21T00:44:17.674120+0000","last_unstale":"2024-09-21T00:45:46.665246+0000","last_undegraded":"2024-09-21T00:45:46.665246+0000","last_fullsized":"2024-09-21T00:45:46.665246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:54.992101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.808921+0000","last_change":"2024-09-21T00:44:47.808807+0000","last_active":"2024-09-21T00:44:47.808921+0000","last_peered":"2024-09-21T00:44:47.808921+0000","last_clean":"2024-09-21T00:44:47.808921+0000","last_became_active":"2024-09-21T00:44:47.805581+0000","last_became_peered":"2024-09-21T00:44:47.805581+0000","last_unstale":"2024-09-21T00:44:47.808921+0000","last_undegraded":"2024-09-21T00:44:47.808921+0000","last_fullsized":"2024-09-21T00:44:47.808921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.570140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.646995+0000","last_change":"2024-09-21T00:44:47.804921+0000","last_active":"2024-09-21T00:45:46.646995+0000","last_peered":"2024-09-21T00:45:46.646995+0000","last_clean":"2024-09-21T00:45:46.646995+0000","last_became_active":"2024-09-21T00:44:47.804531+0000","last_became_peered":"2024-09-21T00:44:47.804531+0000","last_unstale":"2024-09-21T00:45:46.646995+0000","last_undegraded":"2024-09-21T00:45:46.646995+0000","last_fullsized":"2024-09-21T00:45:46.646995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:56.462438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:13.918505+0000","last_change":"2024-09-21T00:44:15.672146+0000","last_active":"2024-09-21T00:46:13.918505+0000","last_peered":"2024-09-21T00:46:13.918505+0000","last_clean":"2024-09-21T00:46:13.918505+0000","last_became_active":"2024-09-21T00:44:15.671650+0000","last_became_peered":"2024-09-21T00:44:15.671650+0000","last_unstale":"2024-09-21T00:46:13.918505+0000","last_undegraded":"2024-09-21T00:46:13.918505+0000","last_fullsized":"2024-09-21T00:46:13.918505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:01.298807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661217+0000","last_change":"2024-09-21T00:44:17.681676+0000","last_active":"2024-09-21T00:45:46.661217+0000","last_peered":"2024-09-21T00:45:46.661217+0000","last_clean":"2024-09-21T00:45:46.661217+0000","last_became_active":"2024-09-21T00:44:17.681260+0000","last_became_peered":"2024-09-21T00:44:17.681260+0000","last_unstale":"2024-09-21T00:45:46.661217+0000","last_undegraded":"2024-09-21T00:45:46.661217+0000","last_fullsized":"2024-09-21T00:45:46.661217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:37.786115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'7","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:12.917527+0000","last_change":"2024-09-21T00:44:15.657534+0000","last_active":"2024-09-21T00:46:12.917527+0000","last_peered":"2024-09-21T00:46:12.917527+0000","last_clean":"2024-09-21T00:46:12.917527+0000","last_became_active":"2024-09-21T00:44:15.656937+0000","last_became_peered":"2024-09-21T00:44:15.656937+0000","last_unstale":"2024-09-21T00:46:12.917527+0000","last_undegraded":"2024-09-21T00:46:12.917527+0000","last_fullsized":"2024-09-21T00:46:12.917527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:07.799294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652794+0000","last_change":"2024-09-21T00:44:17.688711+0000","last_active":"2024-09-21T00:45:46.652794+0000","last_peered":"2024-09-21T00:45:46.652794+0000","last_clean":"2024-09-21T00:45:46.652794+0000","last_became_active":"2024-09-21T00:44:17.688284+0000","last_became_peered":"2024-09-21T00:44:17.688284+0000","last_unstale":"2024-09-21T00:45:46.652794+0000","last_undegraded":"2024-09-21T00:45:46.652794+0000","last_fullsized":"2024-09-21T00:45:46.652794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:41.630285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.796811+0000","last_change":"2024-09-21T00:44:15.675375+0000","last_active":"2024-09-21T00:44:47.796811+0000","last_peered":"2024-09-21T00:44:47.796811+0000","last_clean":"2024-09-21T00:44:47.796811+0000","last_became_active":"2024-09-21T00:44:15.675003+0000","last_became_peered":"2024-09-21T00:44:15.675003+0000","last_unstale":"2024-09-21T00:44:47.796811+0000","last_undegraded":"2024-09-21T00:44:47.796811+0000","last_fullsized":"2024-09-21T00:44:47.796811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:15.820782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660885+0000","last_change":"2024-09-21T00:44:17.676003+0000","last_active":"2024-09-21T00:45:46.660885+0000","last_peered":"2024-09-21T00:45:46.660885+0000","last_clean":"2024-09-21T00:45:46.660885+0000","last_became_active":"2024-09-21T00:44:17.675283+0000","last_became_peered":"2024-09-21T00:44:17.675283+0000","last_unstale":"2024-09-21T00:45:46.660885+0000","last_undegraded":"2024-09-21T00:45:46.660885+0000","last_fullsized":"2024-09-21T00:45:46.660885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:07.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800530+0000","last_change":"2024-09-21T00:44:15.673365+0000","last_active":"2024-09-21T00:44:47.800530+0000","last_peered":"2024-09-21T00:44:47.800530+0000","last_clean":"2024-09-21T00:44:47.800530+0000","last_became_active":"2024-09-21T00:44:15.672973+0000","last_became_peered":"2024-09-21T00:44:15.672973+0000","last_unstale":"2024-09-21T00:44:47.800530+0000","last_undegraded":"2024-09-21T00:44:47.800530+0000","last_fullsized":"2024-09-21T00:44:47.800530+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:17.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.650572+0000","last_change":"2024-09-21T00:44:17.676059+0000","last_active":"2024-09-21T00:45:46.650572+0000","last_peered":"2024-09-21T00:45:46.650572+0000","last_clean":"2024-09-21T00:45:46.650572+0000","last_became_active":"2024-09-21T00:44:17.675633+0000","last_became_peered":"2024-09-21T00:44:17.675633+0000","last_unstale":"2024-09-21T00:45:46.650572+0000","last_undegraded":"2024-09-21T00:45:46.650572+0000","last_fullsized":"2024-09-21T00:45:46.650572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:35.551976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'18","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.698553+0000","last_change":"2024-09-21T00:44:15.659124+0000","last_active":"2024-09-21T00:45:46.698553+0000","last_peered":"2024-09-21T00:45:46.698553+0000","last_clean":"2024-09-21T00:45:46.698553+0000","last_became_active":"2024-09-21T00:44:15.658762+0000","last_became_peered":"2024-09-21T00:44:15.658762+0000","last_unstale":"2024-09-21T00:45:46.698553+0000","last_undegraded":"2024-09-21T00:45:46.698553+0000","last_fullsized":"2024-09-21T00:45:46.698553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:01.333080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.663883+0000","last_change":"2024-09-21T00:44:17.677848+0000","last_active":"2024-09-21T00:45:46.663883+0000","last_peered":"2024-09-21T00:45:46.663883+0000","last_clean":"2024-09-21T00:45:46.663883+0000","last_became_active":"2024-09-21T00:44:17.677468+0000","last_became_peered":"2024-09-21T00:44:17.677468+0000","last_unstale":"2024-09-21T00:45:46.663883+0000","last_undegraded":"2024-09-21T00:45:46.663883+0000","last_fullsized":"2024-09-21T00:45:46.663883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:35.922532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800939+0000","last_change":"2024-09-21T00:44:16.130676+0000","last_active":"2024-09-21T00:44:47.800939+0000","last_peered":"2024-09-21T00:44:47.800939+0000","last_clean":"2024-09-21T00:44:47.800939+0000","last_became_active":"2024-09-21T00:44:16.130214+0000","last_became_peered":"2024-09-21T00:44:16.130214+0000","last_unstale":"2024-09-21T00:44:47.800939+0000","last_undegraded":"2024-09-21T00:44:47.800939+0000","last_fullsized":"2024-09-21T00:44:47.800939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.008158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657262+0000","last_change":"2024-09-21T00:44:17.679317+0000","last_active":"2024-09-21T00:45:46.657262+0000","last_peered":"2024-09-21T00:45:46.657262+0000","last_clean":"2024-09-21T00:45:46.657262+0000","last_became_active":"2024-09-21T00:44:17.678979+0000","last_became_peered":"2024-09-21T00:44:17.678979+0000","last_unstale":"2024-09-21T00:45:46.657262+0000","last_undegraded":"2024-09-21T00:45:46.657262+0000","last_fullsized":"2024-09-21T00:45:46.657262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:20.023166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.843924+0000","last_change":"2024-09-21T00:44:15.672369+0000","last_active":"2024-09-21T00:44:47.843924+0000","last_peered":"2024-09-21T00:44:47.843924+0000","last_clean":"2024-09-21T00:44:47.843924+0000","last_became_active":"2024-09-21T00:44:15.671969+0000","last_became_peered":"2024-09-21T00:44:15.671969+0000","last_unstale":"2024-09-21T00:44:47.843924+0000","last_undegraded":"2024-09-21T00:44:47.843924+0000","last_fullsized":"2024-09-21T00:44:47.843924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:59.461881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.613199+0000","last_change":"2024-09-21T00:44:17.685492+0000","last_active":"2024-09-21T00:45:46.613199+0000","last_peered":"2024-09-21T00:45:46.613199+0000","last_clean":"2024-09-21T00:45:46.613199+0000","last_became_active":"2024-09-21T00:44:17.685102+0000","last_became_peered":"2024-09-21T00:44:17.685102+0000","last_unstale":"2024-09-21T00:45:46.613199+0000","last_undegraded":"2024-09-21T00:45:46.613199+0000","last_fullsized":"2024-09-21T00:45:46.613199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:56.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800965+0000","last_change":"2024-09-21T00:44:15.661267+0000","last_active":"2024-09-21T00:44:47.800965+0000","last_peered":"2024-09-21T00:44:47.800965+0000","last_clean":"2024-09-21T00:44:47.800965+0000","last_became_active":"2024-09-21T00:44:15.660822+0000","last_became_peered":"2024-09-21T00:44:15.660822+0000","last_unstale":"2024-09-21T00:44:47.800965+0000","last_undegraded":"2024-09-21T00:44:47.800965+0000","last_fullsized":"2024-09-21T00:44:47.800965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:49.959486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.652879+0000","last_change":"2024-09-21T00:44:17.676804+0000","last_active":"2024-09-21T00:45:46.652879+0000","last_peered":"2024-09-21T00:45:46.652879+0000","last_clean":"2024-09-21T00:45:46.652879+0000","last_became_active":"2024-09-21T00:44:17.676389+0000","last_became_peered":"2024-09-21T00:44:17.676389+0000","last_unstale":"2024-09-21T00:45:46.652879+0000","last_undegraded":"2024-09-21T00:45:46.652879+0000","last_fullsized":"2024-09-21T00:45:46.652879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:11:11.578208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.803471+0000","last_change":"2024-09-21T00:44:15.659866+0000","last_active":"2024-09-21T00:44:47.803471+0000","last_peered":"2024-09-21T00:44:47.803471+0000","last_clean":"2024-09-21T00:44:47.803471+0000","last_became_active":"2024-09-21T00:44:15.659469+0000","last_became_peered":"2024-09-21T00:44:15.659469+0000","last_unstale":"2024-09-21T00:44:47.803471+0000","last_undegraded":"2024-09-21T00:44:47.803471+0000","last_fullsized":"2024-09-21T00:44:47.803471+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:01.764558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.661403+0000","last_change":"2024-09-21T00:44:17.679676+0000","last_active":"2024-09-21T00:45:46.661403+0000","last_peered":"2024-09-21T00:45:46.661403+0000","last_clean":"2024-09-21T00:45:46.661403+0000","last_became_active":"2024-09-21T00:44:17.679343+0000","last_became_peered":"2024-09-21T00:44:17.679343+0000","last_unstale":"2024-09-21T00:45:46.661403+0000","last_undegraded":"2024-09-21T00:45:46.661403+0000","last_fullsized":"2024-09-21T00:45:46.661403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:45.183756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.800088+0000","last_change":"2024-09-21T00:44:15.663896+0000","last_active":"2024-09-21T00:44:47.800088+0000","last_peered":"2024-09-21T00:44:47.800088+0000","last_clean":"2024-09-21T00:44:47.800088+0000","last_became_active":"2024-09-21T00:44:15.663527+0000","last_became_peered":"2024-09-21T00:44:15.663527+0000","last_unstale":"2024-09-21T00:44:47.800088+0000","last_undegraded":"2024-09-21T00:44:47.800088+0000","last_fullsized":"2024-09-21T00:44:47.800088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:10.590637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.669311+0000","last_change":"2024-09-21T00:44:17.670830+0000","last_active":"2024-09-21T00:45:46.669311+0000","last_peered":"2024-09-21T00:45:46.669311+0000","last_clean":"2024-09-21T00:45:46.669311+0000","last_became_active":"2024-09-21T00:44:17.669643+0000","last_became_peered":"2024-09-21T00:44:17.669643+0000","last_unstale":"2024-09-21T00:45:46.669311+0000","last_undegraded":"2024-09-21T00:45:46.669311+0000","last_fullsized":"2024-09-21T00:45:46.669311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:54.780816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.660563+0000","last_change":"2024-09-21T00:44:17.679760+0000","last_active":"2024-09-21T00:45:46.660563+0000","last_peered":"2024-09-21T00:45:46.660563+0000","last_clean":"2024-09-21T00:45:46.660563+0000","last_became_active":"2024-09-21T00:44:17.679315+0000","last_became_peered":"2024-09-21T00:44:17.679315+0000","last_unstale":"2024-09-21T00:45:46.660563+0000","last_undegraded":"2024-09-21T00:45:46.660563+0000","last_fullsized":"2024-09-21T00:45:46.660563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:59.602201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.799986+0000","last_change":"2024-09-21T00:44:15.663158+0000","last_active":"2024-09-21T00:44:47.799986+0000","last_peered":"2024-09-21T00:44:47.799986+0000","last_clean":"2024-09-21T00:44:47.799986+0000","last_became_active":"2024-09-21T00:44:15.662728+0000","last_became_peered":"2024-09-21T00:44:15.662728+0000","last_unstale":"2024-09-21T00:44:47.799986+0000","last_undegraded":"2024-09-21T00:44:47.799986+0000","last_fullsized":"2024-09-21T00:44:47.799986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:27.001423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.664461+0000","last_change":"2024-09-21T00:44:17.682045+0000","last_active":"2024-09-21T00:45:46.664461+0000","last_peered":"2024-09-21T00:45:46.664461+0000","last_clean":"2024-09-21T00:45:46.664461+0000","last_became_active":"2024-09-21T00:44:17.681686+0000","last_became_peered":"2024-09-21T00:44:17.681686+0000","last_unstale":"2024-09-21T00:45:46.664461+0000","last_undegraded":"2024-09-21T00:45:46.664461+0000","last_fullsized":"2024-09-21T00:45:46.664461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:52.137888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.862814+0000","last_change":"2024-09-21T00:44:47.862708+0000","last_active":"2024-09-21T00:44:47.862814+0000","last_peered":"2024-09-21T00:44:47.862814+0000","last_clean":"2024-09-21T00:44:47.862814+0000","last_became_active":"2024-09-21T00:44:47.845236+0000","last_became_peered":"2024-09-21T00:44:47.845236+0000","last_unstale":"2024-09-21T00:44:47.862814+0000","last_undegraded":"2024-09-21T00:44:47.862814+0000","last_fullsized":"2024-09-21T00:44:47.862814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:03.770440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.665993+0000","last_change":"2024-09-21T00:44:17.675090+0000","last_active":"2024-09-21T00:45:46.665993+0000","last_peered":"2024-09-21T00:45:46.665993+0000","last_clean":"2024-09-21T00:45:46.665993+0000","last_became_active":"2024-09-21T00:44:17.674509+0000","last_became_peered":"2024-09-21T00:44:17.674509+0000","last_unstale":"2024-09-21T00:45:46.665993+0000","last_undegraded":"2024-09-21T00:45:46.665993+0000","last_fullsized":"2024-09-21T00:45:46.665993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:38.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:44:47.801639+0000","last_change":"2024-09-21T00:44:15.672226+0000","last_active":"2024-09-21T00:44:47.801639+0000","last_peered":"2024-09-21T00:44:47.801639+0000","last_clean":"2024-09-21T00:44:47.801639+0000","last_became_active":"2024-09-21T00:44:15.671801+0000","last_became_peered":"2024-09-21T00:44:15.671801+0000","last_unstale":"2024-09-21T00:44:47.801639+0000","last_undegraded":"2024-09-21T00:44:47.801639+0000","last_fullsized":"2024-09-21T00:44:47.801639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:35.810495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:45:46.657452+0000","last_change":"2024-09-21T00:44:17.671814+0000","last_active":"2024-09-21T00:45:46.657452+0000","last_peered":"2024-09-21T00:45:46.657452+0000","last_clean":"2024-09-21T00:45:46.657452+0000","last_became_active":"2024-09-21T00:44:17.670829+0000","last_became_peered":"2024-09-21T00:44:17.670829+0000","last_unstale":"2024-09-21T00:45:46.657452+0000","last_undegraded":"2024-09-21T00:45:46.657452+0000","last_fullsized":"2024-09-21T00:45:46.657452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:16.647880+0000","last_clean_scrub_stamp":"2024-09-21T00:44:16.647880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:11.965097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":144,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:46:14.919696+0000","last_change":"2024-09-21T00:44:15.659198+0000","last_active":"2024-09-21T00:46:14.919696+0000","last_peered":"2024-09-21T00:46:14.919696+0000","last_clean":"2024-09-21T00:46:14.919696+0000","last_became_active":"2024-09-21T00:44:15.658793+0000","last_became_peered":"2024-09-21T00:44:15.658793+0000","last_unstale":"2024-09-21T00:46:14.919696+0000","last_undegraded":"2024-09-21T00:46:14.919696+0000","last_fullsized":"2024-09-21T00:46:14.919696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:44:14.635404+0000","last_clean_scrub_stamp":"2024-09-21T00:44:14.635404+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:18.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72785,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1092,"num_read_kb":633,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1561,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":218355,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285754,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":400279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005098,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1055543,"data_compressed":38165,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":399677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":50,"seq":214748364853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":400055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":993554,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724607,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":399926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920836,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":992392,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084362,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":399219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":464348,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":465298,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":401265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34708,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36326,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66743,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65793,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66503,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:46:19.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:46:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:19 smithi123 ceph-mon[34853]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T00:46:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:19 smithi123 ceph-mon[34853]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:19.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:19 smithi178 ceph-mon[34888]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T00:46:19.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:19 smithi178 ceph-mon[34888]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 -- 172.21.15.16:0/3164292449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20102ae0 msgr2=0x7f8b20102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 --2- 172.21.15.16:0/3164292449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20102ae0 0x7f8b20102ef0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009900 tx=0x7f8b1002a3f0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 -- 172.21.15.16:0/3164292449 shutdown_connections 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 --2- 172.21.15.16:0/3164292449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20108d20 0x7f8b2010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 --2- 172.21.15.16:0/3164292449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201083d0 0x7f8b201087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 --2- 172.21.15.16:0/3164292449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b20102ae0 0x7f8b20102ef0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 -- 172.21.15.16:0/3164292449 >> 172.21.15.16:0/3164292449 conn(0x7f8b20079760 msgr2=0x7f8b20079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 -- 172.21.15.16:0/3164292449 shutdown_connections 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.411+0000 7f8b2709a640 1 -- 172.21.15.16:0/3164292449 wait complete. 2024-09-21T00:46:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 Processor -- start 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 -- start start 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20102ae0 0x7f8b20104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 0x7f8b20104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20112990 con 0x7f8b201083d0 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20112810 con 0x7f8b20102ae0 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b2709a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20112b10 con 0x7f8b20108d20 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b1ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b1ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38530/0 (socket says 172.21.15.16:38530) 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b1ffff640 1 -- 172.21.15.16:0/2435884703 learned_addr learned my addr 172.21.15.16:0/2435884703 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.412+0000 7f8b24e36640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20102ae0 0x7f8b20104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b25637640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 0x7f8b20104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 -- 172.21.15.16:0/2435884703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 msgr2=0x7f8b20104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 0x7f8b20104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 -- 172.21.15.16:0/2435884703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20102ae0 msgr2=0x7f8b20104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20102ae0 0x7f8b20104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 -- 172.21.15.16:0/2435884703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b201a8680 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b25637640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 0x7f8b20104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1ffff640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c970 tx=0x7f8b1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14014070 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14004440 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b201a8970 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14003e50 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.413+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b201a8f00 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.415+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b20103d10 con 0x7f8b201083d0 2024-09-21T00:46:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.416+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8b14017070 con 0x7f8b201083d0 2024-09-21T00:46:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.417+0000 7f8b1dffb640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 0x7f8b080b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.417+0000 7f8b24e36640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 0x7f8b080b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.417+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8b140e6d40 con 0x7f8b201083d0 2024-09-21T00:46:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.418+0000 7f8b24e36640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 0x7f8b080b8c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b10000c00 tx=0x7f8b10031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.421+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b1401e030 con 0x7f8b201083d0 2024-09-21T00:46:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.650+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b20102ef0 con 0x7f8b201083d0 2024-09-21T00:46:20.651 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:20 smithi016 ceph-mon[30947]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:20.651 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:20 smithi016 ceph-mon[30947]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:20.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.651+0000 7f8b1dffb640 1 -- 172.21.15.16:0/2435884703 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f8b140ad660 con 0x7f8b201083d0 2024-09-21T00:46:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:20.652 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:46:20.653 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.653+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 msgr2=0x7f8b080b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.653+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 0x7f8b080b8c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b10000c00 tx=0x7f8b10031400 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 msgr2=0x7f8b201047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c970 tx=0x7f8b1400ce30 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 shutdown_connections 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8b080b6730 0x7f8b080b8c40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b20108d20 0x7f8b20104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b201083d0 0x7f8b201047c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 --2- 172.21.15.16:0/2435884703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b20102ae0 0x7f8b20104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 >> 172.21.15.16:0/2435884703 conn(0x7f8b20079760 msgr2=0x7f8b20101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:20.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 shutdown_connections 2024-09-21T00:46:20.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:20.654+0000 7f8b2709a640 1 -- 172.21.15.16:0/2435884703 wait complete. 2024-09-21T00:46:20.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:20 smithi123 ceph-mon[34853]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:20.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:20 smithi123 ceph-mon[34853]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:20.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:20 smithi178 ceph-mon[34888]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:20.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:20 smithi178 ceph-mon[34888]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:46:21.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:46:21.613 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:21.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:21 smithi016 ceph-mon[30947]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:46:21.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:21 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2435884703' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:21 smithi123 ceph-mon[34853]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:46:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:21 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2435884703' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:21.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:21 smithi178 ceph-mon[34888]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:46:21.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:21 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2435884703' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:46:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 -- 172.21.15.16:0/1918513298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e01083a0 msgr2=0x7f25e01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 --2- 172.21.15.16:0/1918513298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e01083a0 0x7f25e01087b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009900 tx=0x7f25d402a410 comp rx=0 tx=0).stop 2024-09-21T00:46:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 -- 172.21.15.16:0/1918513298 shutdown_connections 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 --2- 172.21.15.16:0/1918513298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 --2- 172.21.15.16:0/1918513298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e01083a0 0x7f25e01087b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 --2- 172.21.15.16:0/1918513298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e0102a60 0x7f25e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 -- 172.21.15.16:0/1918513298 >> 172.21.15.16:0/1918513298 conn(0x7f25e0079730 msgr2=0x7f25e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 -- 172.21.15.16:0/1918513298 shutdown_connections 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.136+0000 7f25e7823640 1 -- 172.21.15.16:0/1918513298 wait complete. 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 Processor -- start 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 -- start start 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e01083a0 0x7f25e019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0113a80 con 0x7f25e0102a60 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0113900 con 0x7f25e0108cf0 2024-09-21T00:46:22.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e7823640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0113c00 con 0x7f25e01083a0 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e55bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e55bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38560/0 (socket says 172.21.15.16:38560) 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e55bf640 1 -- 172.21.15.16:0/1530530539 learned_addr learned my addr 172.21.15.16:0/1530530539 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e5dc0640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.137+0000 7f25e4dbe640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e01083a0 0x7f25e019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 -- 172.21.15.16:0/1530530539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e01083a0 msgr2=0x7f25e019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e01083a0 0x7f25e019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 -- 172.21.15.16:0/1530530539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 msgr2=0x7f25e019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 -- 172.21.15.16:0/1530530539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01a03e0 con 0x7f25e0102a60 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e5dc0640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e55bf640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f25d000db80 tx=0x7f25d000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0017070 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d0003b70 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00106c0 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e01a06d0 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.138+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a6e30 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.139+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0103ce0 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.141+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f25d0004020 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.141+0000 7f25de7fc640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 0x7f25c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.142+0000 7f25e4dbe640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 0x7f25c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.142+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f25d00e7320 con 0x7f25e0102a60 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.142+0000 7f25e4dbe640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 0x7f25c80b8aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25d4000c00 tx=0x7f25d4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:22.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.146+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25d00adc40 con 0x7f25e0102a60 2024-09-21T00:46:22.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.335+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25e0102e70 con 0x7f25e0102a60 2024-09-21T00:46:22.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.336+0000 7f25de7fc640 1 -- 172.21.15.16:0/1530530539 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f25d00b2020 con 0x7f25e0102a60 2024-09-21T00:46:22.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:22.338 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 msgr2=0x7f25c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 0x7f25c80b8aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25d4000c00 tx=0x7f25d4031400 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 msgr2=0x7f25e019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f25d000db80 tx=0x7f25d000b630 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 shutdown_connections 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25c80b6590 0x7f25c80b8aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25e0108cf0 0x7f25e019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e01083a0 0x7f25e019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 --2- 172.21.15.16:0/1530530539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0102a60 0x7f25e019a470 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:22.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 >> 172.21.15.16:0/1530530539 conn(0x7f25e0079730 msgr2=0x7f25e01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:22.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 shutdown_connections 2024-09-21T00:46:22.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:22.339+0000 7f25e7823640 1 -- 172.21.15.16:0/1530530539 wait complete. 2024-09-21T00:46:22.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1530530539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:22.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:22 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1530530539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:22.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:22 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1530530539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:46:22.963 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T00:46:22.963 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T00:46:22.973 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:46:22.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T00:46:22.974 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T00:46:22.974 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:46:22.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:46:22.976 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T00:46:22.992 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:22.992 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T00:46:22.992 INFO:tasks.workunit:timeout=3h 2024-09-21T00:46:22.992 INFO:tasks.workunit:cleanup=True 2024-09-21T00:46:22.992 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T00:46:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-21 00:44:37.711908883 +0000 2024-09-21T00:46:23.010 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-21 00:44:37.711908883 +0000 2024-09-21T00:46:23.010 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-21 00:46:13.656328063 +0000 2024-09-21T00:46:23.010 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-21 00:44:37.711908883 +0000 2024-09-21T00:46:23.010 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T00:46:23.010 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T00:46:23.080 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:23.136 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T00:46:23.255 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:23.645 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:23 smithi016 ceph-mon[30947]: pgmap v353: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T00:46:23.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 -- 172.21.15.16:0/637483173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c104a30 msgr2=0x7fd09c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 --2- 172.21.15.16:0/637483173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c104a30 0x7fd09c104e40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009900 tx=0x7fd08c02a410 comp rx=0 tx=0).stop 2024-09-21T00:46:23.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 -- 172.21.15.16:0/637483173 shutdown_connections 2024-09-21T00:46:23.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 --2- 172.21.15.16:0/637483173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c10de60 0x7fd09c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 --2- 172.21.15.16:0/637483173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c105380 0x7fd09c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 --2- 172.21.15.16:0/637483173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c104a30 0x7fd09c104e40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 -- 172.21.15.16:0/637483173 >> 172.21.15.16:0/637483173 conn(0x7fd09c079760 msgr2=0x7fd09c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 -- 172.21.15.16:0/637483173 shutdown_connections 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.742+0000 7fd0a281b640 1 -- 172.21.15.16:0/637483173 wait complete. 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.743+0000 7fd0a281b640 1 Processor -- start 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.743+0000 7fd0a281b640 1 -- start start 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.743+0000 7fd0a281b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 0x7fd09c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c105380 0x7fd09c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113ac0 con 0x7fd09c10de60 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113940 con 0x7fd09c104a30 2024-09-21T00:46:23.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c113c40 con 0x7fd09c105380 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38586/0 (socket says 172.21.15.16:38586) 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 -- 172.21.15.16:0/84481701 learned_addr learned my addr 172.21.15.16:0/84481701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd093fff640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c105380 0x7fd09c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd09bfff640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 0x7fd09c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 -- 172.21.15.16:0/84481701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c105380 msgr2=0x7fd09c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c105380 0x7fd09c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 -- 172.21.15.16:0/84481701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 msgr2=0x7fd09c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 0x7fd09c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 -- 172.21.15.16:0/84481701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c1a0440 con 0x7fd09c10de60 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd09bfff640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 0x7fd09c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a0db8640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd09400eaa0 tx=0x7fd09400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd099ffb640 1 -- 172.21.15.16:0/84481701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09400cdb0 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd099ffb640 1 -- 172.21.15.16:0/84481701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd094005020 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c1a0730 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd099ffb640 1 -- 172.21.15.16:0/84481701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0940116d0 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.744+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c1a6e90 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.747+0000 7fd0a8d8f740 1 Processor -- start 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.747+0000 7fd099ffb640 1 -- 172.21.15.16:0/84481701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd094011870 con 0x7fd09c10de60 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.747+0000 7fd0a8d8f740 1 -- start start 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d3f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d3feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5575f1cb5e60 con 0x5575f1998350 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5575f1ca5290 con 0x5575f196f490 2024-09-21T00:46:23.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5575f1ca90a0 con 0x5575f1977670 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38590/0 (socket says 172.21.15.16:38590) 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 -- 172.21.15.16:0/1286430379 learned_addr learned my addr 172.21.15.16:0/1286430379 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd09bfff640 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d3f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d3feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd099ffb640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 -- 172.21.15.16:0/1286430379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 msgr2=0x5575f1d3feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d3feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 -- 172.21.15.16:0/1286430379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 msgr2=0x5575f1d3f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d3f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd093fff640 1 -- 172.21.15.16:0/1286430379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f1a03930 con 0x5575f1998350 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.748+0000 7fd0a0db8640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.749+0000 7fd093fff640 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd08400bfa0 tx=0x7fd08400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a301416cc65a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.749+0000 7fd099ffb640 1 -- 172.21.15.16:0/84481701 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd0940e74b0 con 0x7fd09c10de60 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.749+0000 7fd0927fc640 1 -- 172.21.15.16:0/1286430379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084019030 con 0x5575f1998350 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.749+0000 7fd0927fc640 1 -- 172.21.15.16:0/1286430379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0840118f0 con 0x5575f1998350 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.749+0000 7fd0927fc640 1 -- 172.21.15.16:0/1286430379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08401d6b0 con 0x5575f1998350 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/1286430379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 msgr2=0x5575f1d3f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd08400bfa0 tx=0x7fd08400b650 comp rx=0 tx=0).stop 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a0db8640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 0x7fd0880b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd0940ad330 tx=0x7fd09407a960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/1286430379 shutdown_connections 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d3feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d3f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/1286430379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d3f430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/1286430379 >> 172.21.15.16:0/1286430379 conn(0x5575f198c740 msgr2=0x5575f1d3d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/1286430379 shutdown_connections 2024-09-21T00:46:23.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/1286430379 wait complete. 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 -- start start 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.750+0000 7fd0a8d8f740 1 Processor -- start 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d4f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1998350 0x5575f1d5b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5575f1b06890 con 0x5575f1977670 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5575f1c3fd40 con 0x5575f196f490 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5575f1d51f40 con 0x5575f1998350 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd0a8d8f740 10 client.0 _ll_register_callbacks cb 0x5575f1ca3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38596/0 (socket says 172.21.15.16:38596) 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 -- 172.21.15.16:0/537232523 learned_addr learned my addr 172.21.15.16:0/537232523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd093fff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1998350 0x5575f1d5b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd093fff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d4f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 -- 172.21.15.16:0/537232523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1998350 msgr2=0x5575f1d5b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1998350 0x5575f1d5b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 -- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 msgr2=0x5575f1d4f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d4f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 -- 172.21.15.16:0/537232523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f1d5b7e0 con 0x5575f1977670 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd093fff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d4f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd09bfff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd09c06c8f0 tx=0x7fd08c02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a83829eb5dce4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.751+0000 7fd07b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c040070 con 0x5575f1977670 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd08c004040 con 0x5575f1977670 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0840118f0 con 0x5575f1977670 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd08c035040 con 0x5575f1977670 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:23.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575f1d5e0a0 con 0x5575f1977670 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0840118f0 con 0x5575f1977670 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd08c0048c0 con 0x5575f1977670 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 20 client.15471 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f1956cd0 0x5575f1d615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 4 client.15471 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.752+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575f1cb7db0 con 0x5575f1956cd0 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.753+0000 7fd093fff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f1956cd0 0x5575f1d615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.753+0000 7fd093fff640 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f1956cd0 0x5575f1d615b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ac6aca9e7f352a server_cookie=67435150cc1364ef in_seq=0 out_seq=0 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.753+0000 7fd07b7fe640 10 client.15471 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd07b7fe640 1 -- 172.21.15.16:0/537232523 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575f1cb7db0 con 0x5575f1956cd0 2024-09-21T00:46:23.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd07b7fe640 10 client.15471 handle_command_reply: tid=0 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 client.15471 shutdown 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 msgr2=0x5575f1d4f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd09c06c8f0 tx=0x7fd08c02aa90 comp rx=0 tx=0).stop 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 shutdown_connections 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f1956cd0 0x5575f1d615b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1998350 0x5575f1d5b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1977670 0x5575f1d4f840 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd07b7fe640 0 client.15471 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/537232523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f196f490 0x5575f1d4f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 >> 172.21.15.16:0/537232523 conn(0x5575f198c740 msgr2=0x5575f1d3b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 shutdown_connections 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/537232523 wait complete. 2024-09-21T00:46:23.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.754+0000 7fd0a8d8f740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T00:46:23.772 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:23 smithi123 ceph-mon[34853]: pgmap v353: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.772+0000 7fd0a8d8f740 1 Processor -- start 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.772+0000 7fd0a8d8f740 1 -- start start 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f196f490 0x5575f1d5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 0x5575f1d4c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1ad150 con 0x5575f1998350 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1aec90 con 0x5575f1977670 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1ad820 con 0x5575f196f490 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38602/0 (socket says 172.21.15.16:38602) 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 -- 172.21.15.16:0/3939811518 learned_addr learned my addr 172.21.15.16:0/3939811518 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f196f490 0x5575f1d5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd09bfff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 0x5575f1d4c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 -- 172.21.15.16:0/3939811518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f196f490 msgr2=0x5575f1d5b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f196f490 0x5575f1d5b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 -- 172.21.15.16:0/3939811518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 msgr2=0x5575f1d4c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 0x5575f1d4c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 -- 172.21.15.16:0/3939811518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f1d4e060 con 0x5575f1998350 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd09bfff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 0x5575f1d4c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:23.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.773+0000 7fd093fff640 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c010 tx=0x7fd084015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549f7cc41300093 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.774+0000 7fd091ffb640 1 -- 172.21.15.16:0/3939811518 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08402d040 con 0x5575f1998350 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.774+0000 7fd091ffb640 1 -- 172.21.15.16:0/3939811518 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084011d50 con 0x5575f1998350 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.774+0000 7fd091ffb640 1 -- 172.21.15.16:0/3939811518 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084019040 con 0x5575f1998350 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.774+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/3939811518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 msgr2=0x5575f1d4c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.774+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c010 tx=0x7fd084015040 comp rx=0 tx=0).stop 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/3939811518 shutdown_connections 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f1998350 0x5575f1d4c830 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1977670 0x5575f1d4c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/3939811518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f196f490 0x5575f1d5b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/3939811518 >> 172.21.15.16:0/3939811518 conn(0x5575f198c740 msgr2=0x5575f1d4a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/3939811518 shutdown_connections 2024-09-21T00:46:23.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/3939811518 wait complete. 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 -- start start 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 Processor -- start 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.775+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d57950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1998350 0x5575f1d521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1ae5c0 con 0x5575f196f490 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1adef0 con 0x5575f1998350 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c1ab130 con 0x5575f1977670 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd0a8d8f740 10 client.0 _ll_register_callbacks cb 0x7fd08c005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38610/0 (socket says 172.21.15.16:38610) 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 -- 172.21.15.16:0/288695692 learned_addr learned my addr 172.21.15.16:0/288695692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd09bfff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d57950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 -- 172.21.15.16:0/288695692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 msgr2=0x5575f1d57950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d57950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 -- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1998350 msgr2=0x5575f1d521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1998350 0x5575f1d521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 -- 172.21.15.16:0/288695692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f1d52800 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd093fff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd08400b690 tx=0x7fd084005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734aa04a839a338a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd07b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.776+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084038020 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fd0840118a0 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd084011d50 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd084043050 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 10 client.15477 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575f1dcc880 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084011d50 con 0x5575f196f490 2024-09-21T00:46:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd084003a00 con 0x5575f196f490 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 20 client.15477 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f192c080 0x5575f1dcedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 4 client.15477 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5575f1cb3860 con 0x5575f192c080 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.777+0000 7fd09bfff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f192c080 0x5575f1dcedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.778+0000 7fd09bfff640 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f192c080 0x5575f1dcedf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb65e531eff7186 server_cookie=d30f5e02df901eda in_seq=0 out_seq=0 2024-09-21T00:46:23.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.778+0000 7fd07b7fe640 10 client.15477 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd07b7fe640 1 -- 172.21.15.16:0/288695692 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5575f1cb3860 con 0x5575f192c080 2024-09-21T00:46:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd07b7fe640 10 client.15477 handle_command_reply: tid=0 2024-09-21T00:46:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 client.15477 shutdown 2024-09-21T00:46:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 msgr2=0x5575f1d57410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd08400b690 tx=0x7fd084005740 comp rx=0 tx=0).stop 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 shutdown_connections 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5575f192c080 0x5575f1dcedf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5575f1998350 0x5575f1d521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575f1977670 0x5575f1d57950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 --2- 172.21.15.16:0/288695692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575f196f490 0x5575f1d57410 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 >> 172.21.15.16:0/288695692 conn(0x5575f198c740 msgr2=0x5575f1d4a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd07b7fe640 0 client.15477 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 shutdown_connections 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 1 -- 172.21.15.16:0/288695692 wait complete. 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.780+0000 7fd0a8d8f740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T00:46:23.784 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "b48866e0-3f81-43b8-b9d9-9af98dd7a373", 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 msgr2=0x7fd0880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 0x7fd0880b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd0940ad330 tx=0x7fd09407a960 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 msgr2=0x7fd09c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd09400eaa0 tx=0x7fd09400ef60 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 shutdown_connections 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fd0880b6590 0x7fd0880b8aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd09c10de60 0x7fd09c19fd10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd09c105380 0x7fd09c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 --2- 172.21.15.16:0/84481701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd09c104a30 0x7fd09c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 >> 172.21.15.16:0/84481701 conn(0x7fd09c079760 msgr2=0x7fd09c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 shutdown_connections 2024-09-21T00:46:23.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:23.781+0000 7fd0a281b640 1 -- 172.21.15.16:0/84481701 wait complete. 2024-09-21T00:46:23.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:23 smithi178 ceph-mon[34888]: pgmap v353: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T00:46:24.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:46:24.806 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 -- 172.21.15.16:0/3754420017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8330109e40 msgr2=0x7f8330110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 --2- 172.21.15.16:0/3754420017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8330109e40 0x7f8330110670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8328009ca0 tx=0x7f832802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 -- 172.21.15.16:0/3754420017 shutdown_connections 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 --2- 172.21.15.16:0/3754420017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8330109e40 0x7f8330110670 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 --2- 172.21.15.16:0/3754420017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83301094f0 0x7f8330109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 --2- 172.21.15.16:0/3754420017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 0x7f8330103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 -- 172.21.15.16:0/3754420017 >> 172.21.15.16:0/3754420017 conn(0x7f83300ff600 msgr2=0x7f8330101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 -- 172.21.15.16:0/3754420017 shutdown_connections 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.289+0000 7f8335cae640 1 -- 172.21.15.16:0/3754420017 wait complete. 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 Processor -- start 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 -- start start 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 0x7f833019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 0x7f833019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8330113b00 con 0x7f83301094f0 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8330113980 con 0x7f8330109e40 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.290+0000 7f8335cae640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8330113c80 con 0x7f8330103bb0 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50360/0 (socket says 172.21.15.16:50360) 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 -- 172.21.15.16:0/38147051 learned_addr learned my addr 172.21.15.16:0/38147051 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832f7fe640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 0x7f833019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832ffff640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 0x7f833019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 -- 172.21.15.16:0/38147051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 msgr2=0x7f833019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 0x7f833019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 -- 172.21.15.16:0/38147051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 msgr2=0x7f833019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 0x7f833019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 -- 172.21.15.16:0/38147051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83301a0340 con 0x7f83301094f0 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832ffff640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 0x7f833019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832effd640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f832400c8c0 tx=0x7f832400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832cff9640 1 -- 172.21.15.16:0/38147051 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324007bb0 con 0x7f83301094f0 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832cff9640 1 -- 172.21.15.16:0/38147051 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8324007d50 con 0x7f83301094f0 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f832cff9640 1 -- 172.21.15.16:0/38147051 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240187c0 con 0x7f83301094f0 2024-09-21T00:46:25.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83301a0630 con 0x7f83301094f0 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.291+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83301a6e50 con 0x7f83301094f0 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 Processor -- start 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 -- start start 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f832cff9640 1 -- 172.21.15.16:0/38147051 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f832400fa20 con 0x7f83301094f0 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503359650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 0x55e50335a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5032cfe50 con 0x55e502f891b0 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e5032bf280 con 0x55e502f91390 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f833c222740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e5032c3090 con 0x55e502fb2070 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.294+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50364/0 (socket says 172.21.15.16:50364) 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 -- 172.21.15.16:0/2355198905 learned_addr learned my addr 172.21.15.16:0/2355198905 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832effd640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 0x55e50335a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832ffff640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503359650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 -- 172.21.15.16:0/2355198905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 msgr2=0x55e503359650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503359650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 -- 172.21.15.16:0/2355198905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 msgr2=0x55e50335a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 0x55e50335a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 -- 172.21.15.16:0/2355198905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e50301d650 con 0x55e502f891b0 2024-09-21T00:46:25.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832effd640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 0x55e50335a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:25.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832f7fe640 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f832000bcf0 tx=0x7f832000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aeec385f71e818 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832cff9640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 0x7f83180b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832ffff640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 0x7f83180b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f8315ffb640 1 -- 172.21.15.16:0/2355198905 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320015070 con 0x55e502f891b0 2024-09-21T00:46:25.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f832cff9640 1 -- 172.21.15.16:0/38147051 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f83240e73e0 con 0x7f83301094f0 2024-09-21T00:46:25.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f8315ffb640 1 -- 172.21.15.16:0/2355198905 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83200118f0 con 0x55e502f891b0 2024-09-21T00:46:25.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.295+0000 7f8315ffb640 1 -- 172.21.15.16:0/2355198905 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200107f0 con 0x55e502f891b0 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 -- 172.21.15.16:0/2355198905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 msgr2=0x55e503359b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f832ffff640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 0x7f83180b8a50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f832802f500 tx=0x7f832802f310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f832000bcf0 tx=0x7f832000f730 comp rx=0 tx=0).stop 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 -- 172.21.15.16:0/2355198905 shutdown_connections 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f91390 0x55e50335a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f891b0 0x55e503359b90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 --2- 172.21.15.16:0/2355198905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503359650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.296+0000 7f833c222740 1 -- 172.21.15.16:0/2355198905 >> 172.21.15.16:0/2355198905 conn(0x55e502fa6460 msgr2=0x55e503357540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.297+0000 7f833c222740 1 -- 172.21.15.16:0/2355198905 shutdown_connections 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.297+0000 7f833c222740 1 -- 172.21.15.16:0/2355198905 wait complete. 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.297+0000 7f833c222740 1 -- start start 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.297+0000 7f833c222740 1 Processor -- start 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503364cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503375590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e503120700 con 0x55e502f91390 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e50325a110 con 0x55e502f891b0 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e503367e30 con 0x55e502fb2070 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f833c222740 10 client.0 _ll_register_callbacks cb 0x55e503273990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:25.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50374/0 (socket says 172.21.15.16:50374) 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 -- 172.21.15.16:0/288312370 learned_addr learned my addr 172.21.15.16:0/288312370 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832f7fe640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503364cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832ffff640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503375590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 -- 172.21.15.16:0/288312370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 msgr2=0x55e503375590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503375590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 -- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 msgr2=0x55e503364cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503364cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 -- 172.21.15.16:0/288312370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e503287c40 con 0x55e502f91390 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f832effd640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f83240aa870 tx=0x7f83240a95d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de338b9e9b80143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.298+0000 7f830effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240ad110 con 0x55e502f91390 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f83240b6040 con 0x55e502f91390 2024-09-21T00:46:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83200118f0 con 0x55e502f91390 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f83240add00 con 0x55e502f91390 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e503377f70 con 0x55e502f91390 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83200118f0 con 0x55e502f91390 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83240a9070 con 0x55e502f91390 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:25.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 20 client.15489 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f709f0 0x55e50337b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 4 client.15489 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.299+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5032d1da0 con 0x55e502f709f0 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.300+0000 7f832f7fe640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f709f0 0x55e50337b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.300+0000 7f832f7fe640 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f709f0 0x55e50337b4a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b143cb24ee950f0 server_cookie=92667845412cb64e in_seq=0 out_seq=0 2024-09-21T00:46:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.300+0000 7f830effd640 10 client.15489 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f830effd640 1 -- 172.21.15.16:0/288312370 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5032d1da0 con 0x55e502f709f0 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f830effd640 10 client.15489 handle_command_reply: tid=0 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 client.15489 shutdown 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 msgr2=0x55e503365230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f83240aa870 tx=0x7f83240a95d0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 shutdown_connections 2024-09-21T00:46:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f709f0 0x55e50337b4a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502fb2070 0x55e503375590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503365230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 --2- 172.21.15.16:0/288312370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503364cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 >> 172.21.15.16:0/288312370 conn(0x55e502fa6460 msgr2=0x55e50335c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.301+0000 7f830effd640 0 client.15489 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.302+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 shutdown_connections 2024-09-21T00:46:25.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.302+0000 7f833c222740 1 -- 172.21.15.16:0/288312370 wait complete. 2024-09-21T00:46:25.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.302+0000 7f833c222740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T00:46:25.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 Processor -- start 2024-09-21T00:46:25.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 -- start start 2024-09-21T00:46:25.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f891b0 0x55e50335ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502fb2070 0x55e5033570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f83301acfa0 con 0x55e502f91390 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83301aeae0 con 0x55e502fb2070 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f833c222740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f83301ad670 con 0x55e502f891b0 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f832effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50384/0 (socket says 172.21.15.16:50384) 2024-09-21T00:46:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.319+0000 7f832effd640 1 -- 172.21.15.16:0/1011590022 learned_addr learned my addr 172.21.15.16:0/1011590022 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832f7fe640 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f891b0 0x55e50335ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832ffff640 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502fb2070 0x55e5033570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 -- 172.21.15.16:0/1011590022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f891b0 msgr2=0x55e50335ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f891b0 0x55e50335ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 -- 172.21.15.16:0/1011590022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502fb2070 msgr2=0x55e5033570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502fb2070 0x55e5033570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 -- 172.21.15.16:0/1011590022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e503358300 con 0x55e502f91390 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f832effd640 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f832400cfd0 tx=0x7f832401f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a23a4788b78f9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f83157fa640 1 -- 172.21.15.16:0/1011590022 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240acf50 con 0x55e502f91390 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f83157fa640 1 -- 172.21.15.16:0/1011590022 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240ad110 con 0x55e502f91390 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.320+0000 7f83157fa640 1 -- 172.21.15.16:0/1011590022 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240acac0 con 0x55e502f91390 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- 172.21.15.16:0/1011590022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 msgr2=0x55e503356b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f832400cfd0 tx=0x7f832401f600 comp rx=0 tx=0).stop 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- 172.21.15.16:0/1011590022 shutdown_connections 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502fb2070 0x55e5033570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502f91390 0x55e503356b70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 --2- 172.21.15.16:0/1011590022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f891b0 0x55e50335ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- 172.21.15.16:0/1011590022 >> 172.21.15.16:0/1011590022 conn(0x55e502fa6460 msgr2=0x55e50335a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- 172.21.15.16:0/1011590022 shutdown_connections 2024-09-21T00:46:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- 172.21.15.16:0/1011590022 wait complete. 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.321+0000 7f833c222740 1 -- start start 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 Processor -- start 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f91390 0x55e50336d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f83301ae410 con 0x55e502fb2070 2024-09-21T00:46:25.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83301add40 con 0x55e502f891b0 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f83301aafa0 con 0x55e502f91390 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f833c222740 10 client.0 _ll_register_callbacks cb 0x7f83240a9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50394/0 (socket says 172.21.15.16:50394) 2024-09-21T00:46:25.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:44202/0 (socket says 172.21.15.16:44202) 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832ffff640 1 -- 172.21.15.16:0/1555989646 learned_addr learned my addr 172.21.15.16:0/1555989646 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832effd640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f91390 0x55e50336d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.322+0000 7f832f7fe640 1 -- 172.21.15.16:0/1555989646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f91390 msgr2=0x55e50336d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832f7fe640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f91390 0x55e50336d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832f7fe640 1 -- 172.21.15.16:0/1555989646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 msgr2=0x55e50336d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832f7fe640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832f7fe640 1 -- 172.21.15.16:0/1555989646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50336def0 con 0x55e502f891b0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832ffff640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f832f7fe640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f832000bcc0 tx=0x7f832000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f5ac59523603e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f830effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320031060 con 0x55e502f891b0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83240ad110 con 0x55e502f891b0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8320005240 con 0x55e502f891b0 2024-09-21T00:46:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8320015030 con 0x55e502f891b0 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f833c222740 10 client.25181 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e5033e5d70 con 0x55e502f891b0 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.323+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240ad110 con 0x55e502f891b0 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83200114c0 con 0x55e502f891b0 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 10 client.25181 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:25.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 10 client.25181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 20 client.25181 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f45da0 0x55e5033e8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 4 client.25181 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5032cd850 con 0x55e502f45da0 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f832effd640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f45da0 0x55e5033e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f832effd640 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f45da0 0x55e5033e8280 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef89947b24c3a465 server_cookie=cffd910fe08a8476 in_seq=0 out_seq=0 2024-09-21T00:46:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.324+0000 7f830effd640 10 client.25181 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f830effd640 1 -- 172.21.15.16:0/1555989646 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e5032cd850 con 0x55e502f45da0 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f830effd640 10 client.25181 handle_command_reply: tid=0 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 client.25181 shutdown 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 msgr2=0x55e503371cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f832000bcc0 tx=0x7f832000ba10 comp rx=0 tx=0).stop 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 shutdown_connections 2024-09-21T00:46:25.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e502f45da0 0x55e5033e8280 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e502fb2070 0x55e50336d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e502f91390 0x55e50336d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 --2- 172.21.15.16:0/1555989646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e502f891b0 0x55e503371cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f830effd640 0 client.25181 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 >> 172.21.15.16:0/1555989646 conn(0x55e502fa6460 msgr2=0x55e503366100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 shutdown_connections 2024-09-21T00:46:25.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 1 -- 172.21.15.16:0/1555989646 wait complete. 2024-09-21T00:46:25.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.325+0000 7f833c222740 20 client.25181 trim_cache size 0 max 16384 2024-09-21T00:46:25.341 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:25.341 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:46:25.341 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: "b48866e0-3f81-43b8-b9d9-9af98dd7a373": { 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "b48866e0-3f81-43b8-b9d9-9af98dd7a373", 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:46:25.342 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "b48866e0-3f81-43b8-b9d9-9af98dd7a373": { 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:46:23.778707+0000", 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:46:25.343 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:46:25.344 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:46:25.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:46:25.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:46:25.344 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:25.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 msgr2=0x7f83180b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 0x7f83180b8a50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f832802f500 tx=0x7f832802f310 comp rx=0 tx=0).stop 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 msgr2=0x7f833019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f832400c8c0 tx=0x7f832400cd80 comp rx=0 tx=0).stop 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 shutdown_connections 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f83180b6540 0x7f83180b8a50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8330109e40 0x7f833019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83301094f0 0x7f833019aa30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 --2- 172.21.15.16:0/38147051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8330103bb0 0x7f833019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:25.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 >> 172.21.15.16:0/38147051 conn(0x7f83300ff600 msgr2=0x7f8330101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:25.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 shutdown_connections 2024-09-21T00:46:25.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:25.326+0000 7f8335cae640 1 -- 172.21.15.16:0/38147051 wait complete. 2024-09-21T00:46:25.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:25 smithi016 ceph-mon[30947]: scrub queued for path: / 2024-09-21T00:46:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:25 smithi016 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:25 smithi016 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-21T00:46:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:25 smithi016 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:25 smithi016 ceph-mon[30947]: pgmap v354: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T00:46:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:25 smithi123 ceph-mon[34853]: scrub queued for path: / 2024-09-21T00:46:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:25 smithi123 ceph-mon[34853]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:25 smithi123 ceph-mon[34853]: scrub summary: active paths [/] 2024-09-21T00:46:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:25 smithi123 ceph-mon[34853]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:25 smithi123 ceph-mon[34853]: pgmap v354: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T00:46:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:25 smithi178 ceph-mon[34888]: scrub queued for path: / 2024-09-21T00:46:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:25 smithi178 ceph-mon[34888]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:25 smithi178 ceph-mon[34888]: scrub summary: active paths [/] 2024-09-21T00:46:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:25 smithi178 ceph-mon[34888]: scrub summary: idle+waiting paths [/] 2024-09-21T00:46:25.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:25 smithi178 ceph-mon[34888]: pgmap v354: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T00:46:26.076 INFO:tasks.cephfs.filesystem:scrub status for tag:b48866e0-3f81-43b8-b9d9-9af98dd7a373 - {'path': '/', 'tag': 'b48866e0-3f81-43b8-b9d9-9af98dd7a373', 'options': 'recursive,force'} 2024-09-21T00:46:26.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:26 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:46:26.747 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:26 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:46:26.774 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:26 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:46:27.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:27 smithi016 ceph-mon[30947]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:46:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:27 smithi123 ceph-mon[34853]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:46:27.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:27 smithi178 ceph-mon[34888]: pgmap v355: 97 pgs: 97 active+clean; 653 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T00:46:28.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:46:28.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:46:28.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:46:28.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:46:30.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:29 smithi016 ceph-mon[30947]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T00:46:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:29 smithi123 ceph-mon[34853]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T00:46:30.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:29 smithi178 ceph-mon[34888]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T00:46:32.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:31 smithi016 ceph-mon[30947]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T00:46:32.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:31 smithi123 ceph-mon[34853]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T00:46:32.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:31 smithi178 ceph-mon[34888]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T00:46:34.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:33 smithi016 ceph-mon[30947]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T00:46:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:33 smithi123 ceph-mon[34853]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T00:46:34.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:33 smithi178 ceph-mon[34888]: pgmap v358: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T00:46:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 -- 172.21.15.16:0/3073214265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 msgr2=0x7f5cb8104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3073214265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb8104b40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009900 tx=0x7f5ca002a410 comp rx=0 tx=0).stop 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 -- 172.21.15.16:0/3073214265 shutdown_connections 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3073214265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 0x7f5cb810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3073214265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb8104b40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3073214265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 0x7f5cb8103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 -- 172.21.15.16:0/3073214265 >> 172.21.15.16:0/3073214265 conn(0x7f5cb80feff0 msgr2=0x7f5cb81014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 -- 172.21.15.16:0/3073214265 shutdown_connections 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.134+0000 7f5cbe863640 1 -- 172.21.15.16:0/3073214265 wait complete. 2024-09-21T00:46:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 Processor -- start 2024-09-21T00:46:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 -- start start 2024-09-21T00:46:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 0x7f5cb8199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 0x7f5cb819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810f2e0 con 0x7f5cb8104730 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810f160 con 0x7f5cb81036b0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cbe863640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810f460 con 0x7f5cb81050d0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.135+0000 7f5cb77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51514/0 (socket says 172.21.15.16:51514) 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 -- 172.21.15.16:0/3415486790 learned_addr learned my addr 172.21.15.16:0/3415486790 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 0x7f5cb8199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cbce00640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 0x7f5cb819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 -- 172.21.15.16:0/3415486790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 msgr2=0x7f5cb819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 0x7f5cb819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 -- 172.21.15.16:0/3415486790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 msgr2=0x7f5cb8199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 0x7f5cb8199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 -- 172.21.15.16:0/3415486790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb819b970 con 0x7f5cb8104730 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006010 tx=0x7f5ca0032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb57fa640 1 -- 172.21.15.16:0/3415486790 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca003f030 con 0x7f5cb8104730 2024-09-21T00:46:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb57fa640 1 -- 172.21.15.16:0/3415486790 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca0003aa0 con 0x7f5cb8104730 2024-09-21T00:46:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb819bc00 con 0x7f5cb8104730 2024-09-21T00:46:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cb57fa640 1 -- 172.21.15.16:0/3415486790 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0035070 con 0x7f5cb8104730 2024-09-21T00:46:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.136+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb819bf10 con 0x7f5cb8104730 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 Processor -- start 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 -- start start 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cb57fa640 1 -- 172.21.15.16:0/3415486790 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5ca0042030 con 0x7f5cb8104730 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010cad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 0x564010cae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564010c1f6f0 con 0x5640109051b0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564010c0eb20 con 0x5640108e44d0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564010c12930 con 0x5640108dc2f0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cbce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cb77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 0x564010cae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cbce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51524/0 (socket says 172.21.15.16:51524) 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cbce00640 1 -- 172.21.15.16:0/2032528170 learned_addr learned my addr 172.21.15.16:0/2032528170 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.140+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010cad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 -- 172.21.15.16:0/2032528170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 msgr2=0x564010cad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010cad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 -- 172.21.15.16:0/2032528170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 msgr2=0x564010cae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 0x564010cae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 -- 172.21.15.16:0/2032528170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564010bd4530 con 0x5640109051b0 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 0x564010cae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:46:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cb57fa640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 0x7f5ca40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cbce00640 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0010370 tx=0x7f5cb0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892530b02cac7b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 0x7f5ca40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cae7fc640 1 -- 172.21.15.16:0/2032528170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0016070 con 0x5640109051b0 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cb57fa640 1 -- 172.21.15.16:0/3415486790 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5ca01077a0 con 0x7f5cb8104730 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cae7fc640 1 -- 172.21.15.16:0/2032528170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb0004d20 con 0x5640109051b0 2024-09-21T00:46:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.141+0000 7f5cae7fc640 1 -- 172.21.15.16:0/2032528170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0005350 con 0x5640109051b0 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 -- 172.21.15.16:0/2032528170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 msgr2=0x564010cace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 0x7f5ca40b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009da0 tx=0x7f5ca8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0010370 tx=0x7f5cb0010830 comp rx=0 tx=0).stop 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 -- 172.21.15.16:0/2032528170 shutdown_connections 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108e44d0 0x564010cae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010cad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/2032528170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cace50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 -- 172.21.15.16:0/2032528170 >> 172.21.15.16:0/2032528170 conn(0x5640108f9300 msgr2=0x564010ca88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 -- 172.21.15.16:0/2032528170 shutdown_connections 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.142+0000 7f5cc57d0740 1 -- 172.21.15.16:0/2032528170 wait complete. 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 -- start start 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 Processor -- start 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cb6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564010b46ab0 con 0x5640108dc2f0 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564010bb4730 con 0x5640109051b0 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564010caeb30 con 0x5640108e44d0 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cb7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cc57d0740 10 client.0 _ll_register_callbacks cb 0x564010c086b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cb7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51538/0 (socket says 172.21.15.16:51538) 2024-09-21T00:46:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.143+0000 7f5cb7fff640 1 -- 172.21.15.16:0/969959796 learned_addr learned my addr 172.21.15.16:0/969959796 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cb6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cbce00640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 -- 172.21.15.16:0/969959796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 msgr2=0x564010cb6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cb6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 -- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 msgr2=0x564010cb7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 -- 172.21.15.16:0/969959796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564010970790 con 0x5640108dc2f0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80045f0 tx=0x7f5ca8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44ae1842f0f680d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca801f640 con 0x5640108dc2f0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5ca801f7e0 con 0x5640108dc2f0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cb0004d20 con 0x5640108dc2f0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ca801f9e0 con 0x5640108dc2f0 2024-09-21T00:46:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cc57d0740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.144+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640109e9620 con 0x5640108dc2f0 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb0004d20 con 0x5640108dc2f0 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ca8032050 con 0x5640108dc2f0 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 20 client.15507 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108c3d80 0x564010cc3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 4 client.15507 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564010c21640 con 0x5640108c3d80 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.145+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108c3d80 0x564010cc3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.146+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108c3d80 0x564010cc3d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82b5540492a24c8 server_cookie=19dfa88cede8844 in_seq=0 out_seq=0 2024-09-21T00:46:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.146+0000 7f5c977fe640 10 client.15507 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5c977fe640 1 -- 172.21.15.16:0/969959796 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564010c21640 con 0x5640108c3d80 2024-09-21T00:46:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5c977fe640 10 client.15507 handle_command_reply: tid=0 2024-09-21T00:46:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 client.15507 shutdown 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 msgr2=0x564010cb65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80045f0 tx=0x7f5ca8004730 comp rx=0 tx=0).stop 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 shutdown_connections 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108c3d80 0x564010cc3d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cb6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5c977fe640 0 client.15507 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/969959796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108dc2f0 0x564010cb65e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 >> 172.21.15.16:0/969959796 conn(0x5640108f9300 msgr2=0x564010ca6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 shutdown_connections 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 1 -- 172.21.15.16:0/969959796 wait complete. 2024-09-21T00:46:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.147+0000 7f5cc57d0740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 Processor -- start 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 -- start start 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010ca7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81aae30 con 0x5640108e44d0 2024-09-21T00:46:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81ac970 con 0x5640109051b0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81ab500 con 0x5640108dc2f0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cb77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cb77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51554/0 (socket says 172.21.15.16:51554) 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cb77fe640 1 -- 172.21.15.16:0/400335125 learned_addr learned my addr 172.21.15.16:0/400335125 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.162+0000 7f5cbce00640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 -- 172.21.15.16:0/400335125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 msgr2=0x564010ca7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010ca7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010ca7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 -- 172.21.15.16:0/400335125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 msgr2=0x564010cb4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 -- 172.21.15.16:0/400335125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564010cbeab0 con 0x5640108e44d0 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cbce00640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0105330 tx=0x7f5ca0107040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eeb6cb348d5da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cadffb640 1 -- 172.21.15.16:0/400335125 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0049040 con 0x5640108e44d0 2024-09-21T00:46:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cadffb640 1 -- 172.21.15.16:0/400335125 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca003b460 con 0x5640108e44d0 2024-09-21T00:46:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.163+0000 7f5cadffb640 1 -- 172.21.15.16:0/400335125 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00c9040 con 0x5640108e44d0 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- 172.21.15.16:0/400335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 msgr2=0x564010ca7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0105330 tx=0x7f5ca0107040 comp rx=0 tx=0).stop 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- 172.21.15.16:0/400335125 shutdown_connections 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640109051b0 0x564010cb4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640108e44d0 0x564010ca7b50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/400335125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108dc2f0 0x564010ca7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- 172.21.15.16:0/400335125 >> 172.21.15.16:0/400335125 conn(0x5640108f9300 msgr2=0x564010ca35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- 172.21.15.16:0/400335125 shutdown_connections 2024-09-21T00:46:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- 172.21.15.16:0/400335125 wait complete. 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 -- start start 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.164+0000 7f5cc57d0740 1 Processor -- start 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108dc2f0 0x564010cbd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cbda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81ac2a0 con 0x5640109051b0 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81abbd0 con 0x5640108dc2f0 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81a8e10 con 0x5640108e44d0 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cc57d0740 10 client.0 _ll_register_callbacks cb 0x7f5ca8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51570/0 (socket says 172.21.15.16:51570) 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 -- 172.21.15.16:0/3292391782 learned_addr learned my addr 172.21.15.16:0/3292391782 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cb77fe640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cbda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108dc2f0 0x564010cbd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 -- 172.21.15.16:0/3292391782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 msgr2=0x564010cbda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cbda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 -- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108dc2f0 msgr2=0x564010cbd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108dc2f0 0x564010cbd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 -- 172.21.15.16:0/3292391782 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564010cbe300 con 0x5640109051b0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5cbce00640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0010370 tx=0x7f5cb0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38bf6cfc5e8952 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.165+0000 7f5c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb002c060 con 0x5640109051b0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5cb00052b0 con 0x5640109051b0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564010c1d0f0 con 0x5640109051b0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5cb0016070 con 0x5640109051b0 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 10 client.15513 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564010d2edc0 con 0x5640109051b0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564010c1d0f0 con 0x5640109051b0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5cb000f040 con 0x5640109051b0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 20 client.15513 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108991c0 0x564010d31630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 4 client.15513 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564010c1a520 con 0x5640108991c0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.166+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108991c0 0x564010d31630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.167+0000 7f5cb7fff640 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108991c0 0x564010d31630 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455749fe3619ab25 server_cookie=7c65380f40f3ead3 in_seq=0 out_seq=0 2024-09-21T00:46:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.167+0000 7f5c977fe640 10 client.15513 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5c977fe640 1 -- 172.21.15.16:0/3292391782 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564010c1a520 con 0x5640108991c0 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5c977fe640 10 client.15513 handle_command_reply: tid=0 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 client.15513 shutdown 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 msgr2=0x564010cbc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0010370 tx=0x7f5cb0003ba0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 shutdown_connections 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5640108991c0 0x564010d31630 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640109051b0 0x564010cbc150 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5640108e44d0 0x564010cbda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5c977fe640 0 client.15513 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 --2- 172.21.15.16:0/3292391782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5640108dc2f0 0x564010cbd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 >> 172.21.15.16:0/3292391782 conn(0x5640108f9300 msgr2=0x564010cb5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 shutdown_connections 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.180+0000 7f5cc57d0740 1 -- 172.21.15.16:0/3292391782 wait complete. 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cc57d0740 20 client.15513 trim_cache size 0 max 16384 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:46:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 msgr2=0x7f5ca40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 0x7f5ca40b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009da0 tx=0x7f5ca8005f90 comp rx=0 tx=0).stop 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 msgr2=0x7f5cb819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006010 tx=0x7f5ca0032f90 comp rx=0 tx=0).stop 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 shutdown_connections 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6510 0x7f5ca40b8a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81050d0 0x7f5cb819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8104730 0x7f5cb819a5a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 --2- 172.21.15.16:0/3415486790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81036b0 0x7f5cb8199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 >> 172.21.15.16:0/3415486790 conn(0x7f5cb80feff0 msgr2=0x7f5cb8107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 shutdown_connections 2024-09-21T00:46:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:36.181+0000 7f5cbe863640 1 -- 172.21.15.16:0/3415486790 wait complete. 2024-09-21T00:46:36.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:35 smithi016 ceph-mon[30947]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:35 smithi123 ceph-mon[34853]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:36.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:35 smithi178 ceph-mon[34888]: pgmap v359: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:37 smithi016 ceph-mon[30947]: pgmap v360: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:38.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:37 smithi016 ceph-mon[30947]: scrub summary: idle 2024-09-21T00:46:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:37 smithi123 ceph-mon[34853]: pgmap v360: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:38.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:37 smithi123 ceph-mon[34853]: scrub summary: idle 2024-09-21T00:46:38.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:37 smithi178 ceph-mon[34888]: pgmap v360: 97 pgs: 97 active+clean; 659 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:38.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:37 smithi178 ceph-mon[34888]: scrub summary: idle 2024-09-21T00:46:40.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:39 smithi016 ceph-mon[30947]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-21T00:46:40.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:39 smithi123 ceph-mon[34853]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-21T00:46:40.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:39 smithi178 ceph-mon[34888]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-21T00:46:42.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:41 smithi016 ceph-mon[30947]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:46:42.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:41 smithi123 ceph-mon[34853]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:46:42.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:41 smithi178 ceph-mon[34888]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:46:44.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:43 smithi016 ceph-mon[30947]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:44.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:43 smithi123 ceph-mon[34853]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:44.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:43 smithi178 ceph-mon[34888]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:46.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:45 smithi016 ceph-mon[30947]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T00:46:46.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:45 smithi123 ceph-mon[34853]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T00:46:46.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:45 smithi178 ceph-mon[34888]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-21T00:46:48.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:47 smithi016 ceph-mon[30947]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 14 op/s 2024-09-21T00:46:48.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:47 smithi123 ceph-mon[34853]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 14 op/s 2024-09-21T00:46:48.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:47 smithi178 ceph-mon[34888]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 14 op/s 2024-09-21T00:46:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 -- 172.21.15.16:0/1370563325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c103620 msgr2=0x7fbd5c103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/1370563325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c103620 0x7fbd5c103a30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009900 tx=0x7fbd4802a410 comp rx=0 tx=0).stop 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 -- 172.21.15.16:0/1370563325 shutdown_connections 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/1370563325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 0x7fbd5c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/1370563325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c103620 0x7fbd5c103a30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/1370563325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 -- 172.21.15.16:0/1370563325 >> 172.21.15.16:0/1370563325 conn(0x7fbd5c0fdee0 msgr2=0x7fbd5c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 -- 172.21.15.16:0/1370563325 shutdown_connections 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.285+0000 7fbd62ac4640 1 -- 172.21.15.16:0/1370563325 wait complete. 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 Processor -- start 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 -- start start 2024-09-21T00:46:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 0x7fbd5c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 0x7fbd5c1a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c10e200 con 0x7fbd5c1025a0 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c10e080 con 0x7fbd5c103620 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd62ac4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c10e380 con 0x7fbd5c103fc0 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd60860640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.286+0000 7fbd60860640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45858/0 (socket says 172.21.15.16:45858) 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 -- 172.21.15.16:0/3239489988 learned_addr learned my addr 172.21.15.16:0/3239489988 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd61061640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 0x7fbd5c1a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 0x7fbd5c19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 -- 172.21.15.16:0/3239489988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 msgr2=0x7fbd5c1a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 0x7fbd5c1a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 -- 172.21.15.16:0/3239489988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 msgr2=0x7fbd5c19ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 0x7fbd5c19ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 -- 172.21.15.16:0/3239489988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c1a1a20 con 0x7fbd5c1025a0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 0x7fbd5c19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd60860640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000d950 tx=0x7fbd5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd59ffb640 1 -- 172.21.15.16:0/3239489988 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50017030 con 0x7fbd5c1025a0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd59ffb640 1 -- 172.21.15.16:0/3239489988 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd50004020 con 0x7fbd5c1025a0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1a1d10 con 0x7fbd5c1025a0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd59ffb640 1 -- 172.21.15.16:0/3239489988 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd500047a0 con 0x7fbd5c1025a0 2024-09-21T00:46:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.287+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1a21b0 con 0x7fbd5c1025a0 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.290+0000 7fbd59ffb640 1 -- 172.21.15.16:0/3239489988 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbd50009a30 con 0x7fbd5c1025a0 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 Processor -- start 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 -- start start 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd59ffb640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 0x55e683eace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683adc2f0 0x55e683ead4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd61061640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e683e1f6f0 con 0x55e683ae44d0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e683e0eb20 con 0x55e683adc2f0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd69a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e683e12930 con 0x55e683b051b0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.291+0000 7fbd59ffb640 1 -- 172.21.15.16:0/3239489988 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd500e6d60 con 0x7fbd5c1025a0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 0x55e683eace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45862/0 (socket says 172.21.15.16:45862) 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd61061640 1 -- 172.21.15.16:0/3346483203 learned_addr learned my addr 172.21.15.16:0/3346483203 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683adc2f0 0x55e683ead4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 -- 172.21.15.16:0/3346483203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683adc2f0 msgr2=0x55e683ead4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683adc2f0 0x55e683ead4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 -- 172.21.15.16:0/3346483203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 msgr2=0x55e683eae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 -- 172.21.15.16:0/3346483203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e683dd4530 con 0x55e683b051b0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd61061640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012c60 tx=0x7fbd54009e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd60860640 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 0x55e683eace50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd500e4940 tx=0x7fbd500ac9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3f6aeafe0b7725 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.292+0000 7fbd46ffd640 1 -- 172.21.15.16:0/3346483203 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd500aca90 con 0x55e683b051b0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.293+0000 7fbd46ffd640 1 -- 172.21.15.16:0/3346483203 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd500ad680 con 0x55e683b051b0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.293+0000 7fbd46ffd640 1 -- 172.21.15.16:0/3346483203 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd500abeb0 con 0x55e683b051b0 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- 172.21.15.16:0/3346483203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 msgr2=0x55e683eace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 0x55e683eace50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd500e4940 tx=0x7fbd500ac9e0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- 172.21.15.16:0/3346483203 shutdown_connections 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683adc2f0 0x55e683ead4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3346483203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683b051b0 0x55e683eace50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- 172.21.15.16:0/3346483203 >> 172.21.15.16:0/3346483203 conn(0x55e683af9300 msgr2=0x55e683ea88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- 172.21.15.16:0/3346483203 shutdown_connections 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- 172.21.15.16:0/3346483203 wait complete. 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 -- start start 2024-09-21T00:46:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.294+0000 7fbd69a30740 1 Processor -- start 2024-09-21T00:46:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683eb6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e683d46ab0 con 0x55e683b051b0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e683db4730 con 0x55e683ae44d0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e683eaead0 con 0x55e683adc2f0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd69a30740 10 client.0 _ll_register_callbacks cb 0x55e683e086b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45874/0 (socket says 172.21.15.16:45874) 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 -- 172.21.15.16:0/3245756700 learned_addr learned my addr 172.21.15.16:0/3245756700 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd60860640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683eb6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 -- 172.21.15.16:0/3245756700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 msgr2=0x55e683eb6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 -- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 msgr2=0x55e683eb6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683eb6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.295+0000 7fbd61061640 1 -- 172.21.15.16:0/3245756700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e683b70790 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd61061640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009e40 tx=0x7fbd54004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e8637d22187dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540207a0 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd54020940 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd500ad680 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd54020b40 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd69a30740 10 client.15525 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e683be9620 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.296+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd500ad680 con 0x55e683b051b0 2024-09-21T00:46:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd54033050 con 0x55e683b051b0 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 20 client.15525 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683ac3d80 0x55e683ec3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 4 client.15525 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e683e21640 con 0x55e683ac3d80 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd60860640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683ac3d80 0x55e683ec3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd3bfff640 10 client.15525 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.297+0000 7fbd60860640 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683ac3d80 0x55e683ec3cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58cb9a44dacd48a0 server_cookie=665509fe18b38ea2 in_seq=0 out_seq=0 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3245756700 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e683e21640 con 0x55e683ac3d80 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd3bfff640 10 client.15525 handle_command_reply: tid=0 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 client.15525 shutdown 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 msgr2=0x55e683eb7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009e40 tx=0x7fbd54004b00 comp rx=0 tx=0).stop 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 shutdown_connections 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683ac3d80 0x55e683ec3cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683b051b0 0x55e683eb7770 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683eb6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3245756700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd3bfff640 0 client.15525 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.298+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 >> 172.21.15.16:0/3245756700 conn(0x55e683af9300 msgr2=0x55e683ea6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.299+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 shutdown_connections 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.299+0000 7fbd69a30740 1 -- 172.21.15.16:0/3245756700 wait complete. 2024-09-21T00:46:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.299+0000 7fbd69a30740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.313+0000 7fbd69a30740 1 Processor -- start 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.313+0000 7fbd69a30740 1 -- start start 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 0x55e683ec3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1aaea0 con 0x55e683ae44d0 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1ac9e0 con 0x55e683ac3d80 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd69a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1ab570 con 0x55e683adc2f0 2024-09-21T00:46:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45882/0 (socket says 172.21.15.16:45882) 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 -- 172.21.15.16:0/1677078535 learned_addr learned my addr 172.21.15.16:0/1677078535 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd60860640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 0x55e683ec3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 -- 172.21.15.16:0/1677078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 msgr2=0x55e683eb4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 -- 172.21.15.16:0/1677078535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 msgr2=0x55e683ec3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 0x55e683ec3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 -- 172.21.15.16:0/1677078535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e683ebea10 con 0x55e683ae44d0 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd60860640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 0x55e683ec3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.314+0000 7fbd61061640 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010bd0 tx=0x7fbd54009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27c01362c7a5397 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd467fc640 1 -- 172.21.15.16:0/1677078535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401eea0 con 0x55e683ae44d0 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd467fc640 1 -- 172.21.15.16:0/1677078535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54009940 con 0x55e683ae44d0 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd467fc640 1 -- 172.21.15.16:0/1677078535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5402a6a0 con 0x55e683ae44d0 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd69a30740 1 -- 172.21.15.16:0/1677078535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 msgr2=0x55e683eb5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd69a30740 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbd54010bd0 tx=0x7fbd54009b80 comp rx=0 tx=0).stop 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.315+0000 7fbd69a30740 1 -- 172.21.15.16:0/1677078535 shutdown_connections 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683ae44d0 0x55e683eb5010 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683adc2f0 0x55e683eb4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- 172.21.15.16:0/1677078535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ac3d80 0x55e683ec3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- 172.21.15.16:0/1677078535 >> 172.21.15.16:0/1677078535 conn(0x55e683af9300 msgr2=0x55e683eb5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- 172.21.15.16:0/1677078535 shutdown_connections 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- 172.21.15.16:0/1677078535 wait complete. 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- start start 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 Processor -- start 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 0x55e683ebb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683ebc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1ac310 con 0x55e683adc2f0 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1abc40 con 0x55e683ae44d0 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1a8ea0 con 0x55e683ac3d80 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.316+0000 7fbd69a30740 10 client.0 _ll_register_callbacks cb 0x7fbd54009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd60860640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 0x55e683ebb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45884/0 (socket says 172.21.15.16:45884) 2024-09-21T00:46:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 -- 172.21.15.16:0/3260381286 learned_addr learned my addr 172.21.15.16:0/3260381286 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd61061640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683ebc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 -- 172.21.15.16:0/3260381286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 msgr2=0x55e683ebb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 0x55e683ebb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 -- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 msgr2=0x55e683ebc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683ebc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 -- 172.21.15.16:0/3260381286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e683ebcef0 con 0x55e683adc2f0 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd61061640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683ebc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd60860640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 0x55e683ebb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd5bfff640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005f70 tx=0x7fbd48032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940a6c70a0834d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48035040 con 0x55e683adc2f0 2024-09-21T00:46:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd48004310 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.317+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e683e1d0f0 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd48005030 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 10 client.15531 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e683ebe1f0 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e683e1d0f0 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd480035f0 con 0x55e683adc2f0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 10 client.15531 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 20 client.15531 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683b051b0 0x55e683f30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 4 client.15531 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e683e1a520 con 0x55e683b051b0 2024-09-21T00:46:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.318+0000 7fbd60860640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683b051b0 0x55e683f30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.319+0000 7fbd3bfff640 10 client.15531 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.319+0000 7fbd60860640 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683b051b0 0x55e683f30940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a3a4047e3bccff6 server_cookie=47befb1377b226a in_seq=0 out_seq=0 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd3bfff640 1 -- 172.21.15.16:0/3260381286 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e683e1a520 con 0x55e683b051b0 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd3bfff640 10 client.15531 handle_command_reply: tid=0 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 client.15531 shutdown 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 msgr2=0x55e683ebbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005f70 tx=0x7fbd48032f90 comp rx=0 tx=0).stop 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 shutdown_connections 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55e683b051b0 0x55e683f30940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e683ae44d0 0x55e683ebc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e683adc2f0 0x55e683ebbc20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd3bfff640 0 client.15531 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 --2- 172.21.15.16:0/3260381286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e683ac3d80 0x55e683ebb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.327+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 >> 172.21.15.16:0/3260381286 conn(0x55e683af9300 msgr2=0x55e683eb0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 shutdown_connections 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd69a30740 1 -- 172.21.15.16:0/3260381286 wait complete. 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd69a30740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:46:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 msgr2=0x7fbd4c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012c60 tx=0x7fbd54009e70 comp rx=0 tx=0).stop 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 msgr2=0x7fbd5c06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000d950 tx=0x7fbd5000de10 comp rx=0 tx=0).stop 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 shutdown_connections 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd4c0b6510 0x7fbd4c0b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c103fc0 0x7fbd5c1a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd5c103620 0x7fbd5c19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 --2- 172.21.15.16:0/3239489988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd5c1025a0 0x7fbd5c06b430 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.328+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 >> 172.21.15.16:0/3239489988 conn(0x7fbd5c0fdee0 msgr2=0x7fbd5c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.329+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 shutdown_connections 2024-09-21T00:46:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:46:49.329+0000 7fbd62ac4640 1 -- 172.21.15.16:0/3239489988 wait complete. 2024-09-21T00:46:50.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:49 smithi016 ceph-mon[30947]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:50.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:49 smithi123 ceph-mon[34853]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:50.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:49 smithi178 ceph-mon[34888]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-21T00:46:52.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:51 smithi016 ceph-mon[30947]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:46:52.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:51 smithi123 ceph-mon[34853]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:46:52.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:51 smithi178 ceph-mon[34888]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:46:54.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:53 smithi016 ceph-mon[30947]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T00:46:54.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:53 smithi123 ceph-mon[34853]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T00:46:54.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:53 smithi178 ceph-mon[34888]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-21T00:46:56.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:46:56.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:55 smithi016 ceph-mon[30947]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:56.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:55 smithi123 ceph-mon[34853]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:56.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:55 smithi178 ceph-mon[34888]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:46:56.422 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 -- 172.21.15.16:0/3933695331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102f50 msgr2=0x7f97dc10fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 --2- 172.21.15.16:0/3933695331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102f50 0x7f97dc10fc70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009900 tx=0x7f97d002a480 comp rx=0 tx=0).stop 2024-09-21T00:46:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 -- 172.21.15.16:0/3933695331 shutdown_connections 2024-09-21T00:46:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 --2- 172.21.15.16:0/3933695331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc1101b0 0x7f97dc1125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 --2- 172.21.15.16:0/3933695331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102f50 0x7f97dc10fc70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 --2- 172.21.15.16:0/3933695331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc102600 0x7f97dc102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 -- 172.21.15.16:0/3933695331 >> 172.21.15.16:0/3933695331 conn(0x7f97dc079730 msgr2=0x7f97dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 -- 172.21.15.16:0/3933695331 shutdown_connections 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.017+0000 7f97e2542640 1 -- 172.21.15.16:0/3933695331 wait complete. 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.018+0000 7f97e2542640 1 Processor -- start 2024-09-21T00:46:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.018+0000 7f97e2542640 1 -- start start 2024-09-21T00:46:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 0x7f97dc19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 0x7f97dc1a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc115ca0 con 0x7f97dc102600 2024-09-21T00:46:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc115b20 con 0x7f97dc102f50 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97e2542640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc115e20 con 0x7f97dc1101b0 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:45830/0 (socket says 172.21.15.16:45830) 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.019+0000 7f97db7fe640 1 -- 172.21.15.16:0/2093649646 learned_addr learned my addr 172.21.15.16:0/2093649646 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97dbfff640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 0x7f97dc19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97e0adf640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 0x7f97dc1a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 -- 172.21.15.16:0/2093649646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 msgr2=0x7f97dc1a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 0x7f97dc1a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 -- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 msgr2=0x7f97dc19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 0x7f97dc19c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 -- 172.21.15.16:0/2093649646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc1a2600 con 0x7f97dc102f50 2024-09-21T00:46:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97dbfff640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 0x7f97dc19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97db7fe640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97d0005940 tx=0x7f97d00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97e0adf640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 0x7f97dc1a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.020+0000 7f97d97fa640 1 -- 172.21.15.16:0/2093649646 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d003f030 con 0x7f97dc102f50 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.021+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc1a2890 con 0x7f97dc102f50 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.021+0000 7f97d97fa640 1 -- 172.21.15.16:0/2093649646 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97d00044c0 con 0x7f97dc102f50 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.021+0000 7f97d97fa640 1 -- 172.21.15.16:0/2093649646 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0035070 con 0x7f97dc102f50 2024-09-21T00:46:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.021+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc1a9050 con 0x7f97dc102f50 2024-09-21T00:46:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.024+0000 7f97e8ab6740 1 Processor -- start 2024-09-21T00:46:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 -- start start 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558e1042ce50 con 0x558e1010f070 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558e1041c280 con 0x558e100ee390 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97e8ab6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558e10420090 con 0x558e100e61b0 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:37928/0 (socket says 172.21.15.16:37928) 2024-09-21T00:46:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.025+0000 7f97dbfff640 1 -- 172.21.15.16:0/3683819827 learned_addr learned my addr 172.21.15.16:0/3683819827 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97dbfff640 1 -- 172.21.15.16:0/3683819827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 msgr2=0x558e104b70d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:46:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104b70d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97dbfff640 1 -- 172.21.15.16:0/3683819827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 msgr2=0x558e104b6650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:46:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97dbfff640 1 -- 172.21.15.16:0/3683819827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e1017a650 con 0x558e100e61b0 2024-09-21T00:46:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.026+0000 7f97d97fa640 1 -- 172.21.15.16:0/2093649646 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f97d0042030 con 0x7f97dc102f50 2024-09-21T00:46:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.027+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009d40 tx=0x7f97cc0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1fa6601d4adf84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.027+0000 7f97c27fc640 1 -- 172.21.15.16:0/3683819827 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc012650 con 0x558e100e61b0 2024-09-21T00:46:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.027+0000 7f97c27fc640 1 -- 172.21.15.16:0/3683819827 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97cc009e30 con 0x558e100e61b0 2024-09-21T00:46:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.027+0000 7f97c27fc640 1 -- 172.21.15.16:0/3683819827 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00fc20 con 0x558e100e61b0 2024-09-21T00:46:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.028+0000 7f97d97fa640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 0x7f97c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.028+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3683819827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 msgr2=0x558e104b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.028+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009d40 tx=0x7f97cc0117b0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e0adf640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 0x7f97c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3683819827 shutdown_connections 2024-09-21T00:46:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100e61b0 0x558e104b6b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3683819827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3683819827 >> 172.21.15.16:0/3683819827 conn(0x558e10103460 msgr2=0x558e104b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97d97fa640 1 -- 172.21.15.16:0/2093649646 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f97d0107710 con 0x7f97dc102f50 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.029+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3683819827 shutdown_connections 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.030+0000 7f97e0adf640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 0x7f97c40b8aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f97d4005fd0 tx=0x7f97d4004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.030+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3683819827 wait complete. 2024-09-21T00:46:57.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.030+0000 7f97e8ab6740 1 -- start start 2024-09-21T00:46:57.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.031+0000 7f97e8ab6740 1 Processor -- start 2024-09-21T00:46:57.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.031+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.031+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.031+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57594/0 (socket says 172.21.15.16:57594) 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 -- 172.21.15.16:0/3772406008 learned_addr learned my addr 172.21.15.16:0/3772406008 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558e1027d700 con 0x558e100e61b0 2024-09-21T00:46:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558e103b7110 con 0x558e100ee390 2024-09-21T00:46:57.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558e104c4e30 con 0x558e1010f070 2024-09-21T00:46:57.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e8ab6740 10 client.0 _ll_register_callbacks cb 0x558e103d0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:57.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97db7fe640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97e0adf640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 -- 172.21.15.16:0/3772406008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 msgr2=0x558e104d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 -- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 msgr2=0x558e104cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.032+0000 7f97dbfff640 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e103e4c40 con 0x558e100e61b0 2024-09-21T00:46:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97dbfff640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00f640 tx=0x7f97cc009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51cc6fb9426fe2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:46:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc028020 con 0x558e100e61b0 2024-09-21T00:46:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97cc009e30 con 0x558e100e61b0 2024-09-21T00:46:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f97cc0053c0 con 0x558e100e61b0 2024-09-21T00:46:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97cc033050 con 0x558e100e61b0 2024-09-21T00:46:57.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97e8ab6740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:57.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.033+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e104d9310 con 0x558e100e61b0 2024-09-21T00:46:57.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97cc009e30 con 0x558e100e61b0 2024-09-21T00:46:57.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97cc012600 con 0x558e100e61b0 2024-09-21T00:46:57.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:57.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:57.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 20 client.15540 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:57.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e100cd9f0 0x558e104dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 4 client.15540 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:46:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e1042eda0 con 0x558e100cd9f0 2024-09-21T00:46:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.034+0000 7f97db7fe640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e100cd9f0 0x558e104dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.035+0000 7f97bb7fe640 10 client.15540 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:57.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.035+0000 7f97db7fe640 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e100cd9f0 0x558e104dcc70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e4e4d53f45cc8a server_cookie=3d5f527804c200f0 in_seq=0 out_seq=0 2024-09-21T00:46:57.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97bb7fe640 1 -- 172.21.15.16:0/3772406008 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e1042eda0 con 0x558e100cd9f0 2024-09-21T00:46:57.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97bb7fe640 10 client.15540 handle_command_reply: tid=0 2024-09-21T00:46:57.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 client.15540 shutdown 2024-09-21T00:46:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 msgr2=0x558e104cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00f640 tx=0x7f97cc009a90 comp rx=0 tx=0).stop 2024-09-21T00:46:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 shutdown_connections 2024-09-21T00:46:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e100cd9f0 0x558e104dcc70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/3772406008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100e61b0 0x558e104cadc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.036+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 >> 172.21.15.16:0/3772406008 conn(0x558e10103460 msgr2=0x558e104b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.037+0000 7f97bb7fe640 0 client.15540 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.037+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 shutdown_connections 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.037+0000 7f97e8ab6740 1 -- 172.21.15.16:0/3772406008 wait complete. 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.037+0000 7f97e8ab6740 20 client.15540 trim_cache size 0 max 16384 2024-09-21T00:46:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.072+0000 7f97e8ab6740 1 Processor -- start 2024-09-21T00:46:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.072+0000 7f97e8ab6740 1 -- start start 2024-09-21T00:46:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57604/0 (socket says 172.21.15.16:57604) 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97dbfff640 1 -- 172.21.15.16:0/1747322738 learned_addr learned my addr 172.21.15.16:0/1747322738 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100a2da0 0x558e104b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc070c00 con 0x558e100ee390 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc072740 con 0x558e100a2da0 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0712d0 con 0x558e1010f070 2024-09-21T00:46:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97dbfff640 1 -- 172.21.15.16:0/1747322738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 msgr2=0x558e104c5d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.073+0000 7f97dbfff640 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104c5d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97dbfff640 1 -- 172.21.15.16:0/1747322738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100a2da0 msgr2=0x558e104b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97dbfff640 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100a2da0 0x558e104b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97dbfff640 1 -- 172.21.15.16:0/1747322738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e104b8940 con 0x558e100ee390 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97dbfff640 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f97cc012bc0 tx=0x7f97cc00ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8396090950008a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97c1ffb640 1 -- 172.21.15.16:0/1747322738 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc028040 con 0x558e100ee390 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97c1ffb640 1 -- 172.21.15.16:0/1747322738 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97cc012c40 con 0x558e100ee390 2024-09-21T00:46:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.074+0000 7f97c1ffb640 1 -- 172.21.15.16:0/1747322738 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0379e0 con 0x558e100ee390 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.075+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 msgr2=0x558e104d71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.075+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f97cc012bc0 tx=0x7f97cc00ffb0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 shutdown_connections 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100a2da0 0x558e104b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e1010f070 0x558e104c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/1747322738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e100ee390 0x558e104d71c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 >> 172.21.15.16:0/1747322738 conn(0x558e10103460 msgr2=0x558e104c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 shutdown_connections 2024-09-21T00:46:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.076+0000 7f97e8ab6740 1 -- 172.21.15.16:0/1747322738 wait complete. 2024-09-21T00:46:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.077+0000 7f97e8ab6740 1 -- start start 2024-09-21T00:46:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.077+0000 7f97e8ab6740 1 Processor -- start 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100a2da0 0x558e104d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e8ab6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e8ab6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc072070 con 0x558e1010f070 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e0adf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:45854/0 (socket says 172.21.15.16:45854) 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97db7fe640 1 -- 172.21.15.16:0/141204505 learned_addr learned my addr 172.21.15.16:0/141204505 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e0adf640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57606/0 (socket says 172.21.15.16:57606) 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97dbfff640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100a2da0 0x558e104d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.078+0000 7f97e8ab6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0719a0 con 0x558e100ee390 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc06ec00 con 0x558e100a2da0 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97e8ab6740 10 client.0 _ll_register_callbacks cb 0x7f97cc009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97db7fe640 1 -- 172.21.15.16:0/141204505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100a2da0 msgr2=0x558e104d6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97db7fe640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100a2da0 0x558e104d6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97db7fe640 1 -- 172.21.15.16:0/141204505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 msgr2=0x558e104d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97db7fe640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.079+0000 7f97db7fe640 1 -- 172.21.15.16:0/141204505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e104d2c00 con 0x558e100ee390 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97db7fe640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f97d00cab00 tx=0x7f97d002a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3ba3b9b809161 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0049040 con 0x558e100ee390 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f97d00cedc0 con 0x558e100ee390 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97cc012c40 con 0x558e100ee390 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97d00e8050 con 0x558e100ee390 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97e8ab6740 10 client.25223 fetch_fsmap learned FSMap version 28 2024-09-21T00:46:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.080+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e10547320 con 0x558e100ee390 2024-09-21T00:46:57.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.081+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97d007b020 con 0x558e100ee390 2024-09-21T00:46:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97d00c91e0 con 0x558e100ee390 2024-09-21T00:46:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 10 client.25223 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:46:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 10 client.25223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:46:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 20 client.25223 populate_metadata read hostname 'smithi016' 2024-09-21T00:46:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e105479f0 0x558e10549e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 4 client.25223 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:46:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.082+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f97cc012c40 con 0x558e105479f0 2024-09-21T00:46:57.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.083+0000 7f97dbfff640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e105479f0 0x558e10549e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:57.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.083+0000 7f97bb7fe640 10 client.25223 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:57.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.083+0000 7f97dbfff640 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e105479f0 0x558e10549e10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820694ac73fd4ea2 server_cookie=d414c38d6e15596f in_seq=0 out_seq=0 2024-09-21T00:46:57.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97bb7fe640 1 -- 172.21.15.16:0/141204505 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f97cc012c40 con 0x558e105479f0 2024-09-21T00:46:57.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97bb7fe640 10 client.25223 handle_command_reply: tid=0 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 client.25223 shutdown 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 msgr2=0x558e104d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f97d00cab00 tx=0x7f97d002a480 comp rx=0 tx=0).stop 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 shutdown_connections 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x558e105479f0 0x558e10549e10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558e1010f070 0x558e104d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97bb7fe640 0 client.25223 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558e100ee390 0x558e104d2180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 --2- 172.21.15.16:0/141204505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558e100a2da0 0x558e104d6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.084+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 >> 172.21.15.16:0/141204505 conn(0x558e10103460 msgr2=0x558e104c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.085+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 shutdown_connections 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.085+0000 7f97e8ab6740 1 -- 172.21.15.16:0/141204505 wait complete. 2024-09-21T00:46:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.085+0000 7f97e8ab6740 20 client.25223 trim_cache size 0 max 16384 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "b48866e0-3f81-43b8-b9d9-9af98dd7a373": { 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:46:23.778707+0000", 2024-09-21T00:46:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:46:57.091 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 msgr2=0x7f97c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 0x7f97c40b8aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f97d4005fd0 tx=0x7f97d4004a40 comp rx=0 tx=0).stop 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 msgr2=0x7f97dc19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97d0005940 tx=0x7f97d00040c0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 shutdown_connections 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f97c40b6590 0x7f97c40b8aa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc1101b0 0x7f97dc1a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97dc102f50 0x7f97dc19cc30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 --2- 172.21.15.16:0/2093649646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97dc102600 0x7f97dc19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.086+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 >> 172.21.15.16:0/2093649646 conn(0x7f97dc079730 msgr2=0x7f97dc108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.087+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 shutdown_connections 2024-09-21T00:46:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:57.087+0000 7f97e2542640 1 -- 172.21.15.16:0/2093649646 wait complete. 2024-09-21T00:46:57.832 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:46:57.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:46:58.157 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:46:58.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:57 smithi016 ceph-mon[30947]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:58.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:57 smithi123 ceph-mon[34853]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:58.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:57 smithi178 ceph-mon[34888]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:46:58.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 -- 172.21.15.16:0/1309915758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10101ff0 msgr2=0x7f8b10102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:58.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 --2- 172.21.15.16:0/1309915758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10101ff0 0x7f8b10102400 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009900 tx=0x7f8b0002a410 comp rx=0 tx=0).stop 2024-09-21T00:46:58.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 -- 172.21.15.16:0/1309915758 shutdown_connections 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 --2- 172.21.15.16:0/1309915758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b10106c20 0x7f8b10110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 --2- 172.21.15.16:0/1309915758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b101062d0 0x7f8b101066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 --2- 172.21.15.16:0/1309915758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10101ff0 0x7f8b10102400 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 -- 172.21.15.16:0/1309915758 >> 172.21.15.16:0/1309915758 conn(0x7f8b10077cc0 msgr2=0x7f8b10078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 -- 172.21.15.16:0/1309915758 shutdown_connections 2024-09-21T00:46:58.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.723+0000 7f8b15b84640 1 -- 172.21.15.16:0/1309915758 wait complete. 2024-09-21T00:46:58.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 Processor -- start 2024-09-21T00:46:58.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 -- start start 2024-09-21T00:46:58.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b10101ff0 0x7f8b1019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:58.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b101062d0 0x7f8b1019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:58.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:58.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10113b30 con 0x7f8b10106c20 2024-09-21T00:46:58.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101139b0 con 0x7f8b10101ff0 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.724+0000 7f8b15b84640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10113cb0 con 0x7f8b101062d0 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57622/0 (socket says 172.21.15.16:57622) 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 -- 172.21.15.16:0/2325088965 learned_addr learned my addr 172.21.15.16:0/2325088965 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0effd640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b101062d0 0x7f8b1019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0f7fe640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b10101ff0 0x7f8b1019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 -- 172.21.15.16:0/2325088965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b101062d0 msgr2=0x7f8b1019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b101062d0 0x7f8b1019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 -- 172.21.15.16:0/2325088965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b10101ff0 msgr2=0x7f8b1019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b10101ff0 0x7f8b1019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 -- 172.21.15.16:0/2325088965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b101a0430 con 0x7f8b10106c20 2024-09-21T00:46:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.725+0000 7f8b0ffff640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800eb10 tx=0x7f8b0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:58.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.726+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800ce60 con 0x7f8b10106c20 2024-09-21T00:46:58.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.726+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08005020 con 0x7f8b10106c20 2024-09-21T00:46:58.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.726+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b101a0720 con 0x7f8b10106c20 2024-09-21T00:46:58.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.726+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08010690 con 0x7f8b10106c20 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.726+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b10102e70 con 0x7f8b10106c20 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.727+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1019b5f0 con 0x7f8b10106c20 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.730+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8b08005510 con 0x7f8b10106c20 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.731+0000 7f8b0cff9640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 0x7f8af80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.731+0000 7f8b0f7fe640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 0x7f8af80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:46:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.731+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8b080e7e20 con 0x7f8b10106c20 2024-09-21T00:46:58.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.732+0000 7f8b0f7fe640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 0x7f8af80b8c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8b00005ab0 tx=0x7f8b00040040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:46:58.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:58.735+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b080ae720 con 0x7f8b10106c20 2024-09-21T00:46:59.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.001+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b1010bba0 con 0x7f8b10106c20 2024-09-21T00:46:59.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.002+0000 7f8b0cff9640 1 -- 172.21.15.16:0/2325088965 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f8b080b2b00 con 0x7f8b10106c20 2024-09-21T00:46:59.003 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:46:59.004 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:46:59.004 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.005+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 msgr2=0x7f8af80b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.005+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 0x7f8af80b8c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8b00005ab0 tx=0x7f8b00040040 comp rx=0 tx=0).stop 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.005+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 msgr2=0x7f8b1019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.005+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800eb10 tx=0x7f8b0800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 shutdown_connections 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8af80b6720 0x7f8af80b8c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b10106c20 0x7f8b1019fd00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b101062d0 0x7f8b1019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:59.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 --2- 172.21.15.16:0/2325088965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b10101ff0 0x7f8b1019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:46:59.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 >> 172.21.15.16:0/2325088965 conn(0x7f8b10077cc0 msgr2=0x7f8b10107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:46:59.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 shutdown_connections 2024-09-21T00:46:59.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:46:59.006+0000 7f8b15b84640 1 -- 172.21.15.16:0/2325088965 wait complete. 2024-09-21T00:46:59.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:47:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:59 smithi016 ceph-mon[30947]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T00:47:00.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:46:59 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2325088965' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:00.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:59 smithi123 ceph-mon[34853]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T00:47:00.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:46:59 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2325088965' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:00.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:59 smithi178 ceph-mon[34888]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T00:47:00.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:46:59 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2325088965' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 -- 172.21.15.16:0/17608784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8107b30 msgr2=0x7f5cb8107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 --2- 172.21.15.16:0/17608784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8107b30 0x7f5cb8107f40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009900 tx=0x7f5ca802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 -- 172.21.15.16:0/17608784 shutdown_connections 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 --2- 172.21.15.16:0/17608784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb8108480 0x7f5cb810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 --2- 172.21.15.16:0/17608784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8107b30 0x7f5cb8107f40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 --2- 172.21.15.16:0/17608784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb81021f0 0x7f5cb8102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 -- 172.21.15.16:0/17608784 >> 172.21.15.16:0/17608784 conn(0x7f5cb8077c60 msgr2=0x7f5cb80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 -- 172.21.15.16:0/17608784 shutdown_connections 2024-09-21T00:47:00.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.675+0000 7f5cc0058640 1 -- 172.21.15.16:0/17608784 wait complete. 2024-09-21T00:47:00.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.676+0000 7f5cc0058640 1 Processor -- start 2024-09-21T00:47:00.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.676+0000 7f5cc0058640 1 -- start start 2024-09-21T00:47:00.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 0x7f5cb8198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb8107b30 0x7f5cb8198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81118c0 con 0x7f5cb8108480 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb8111740 con 0x7f5cb81021f0 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cc0058640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb8111a40 con 0x7f5cb8107b30 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cbe5f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cbe5f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57638/0 (socket says 172.21.15.16:57638) 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/19894689 learned_addr learned my addr 172.21.15.16:0/19894689 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb8107b30 0x7f5cb8198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.677+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 0x7f5cb8198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/19894689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb8107b30 msgr2=0x7f5cb8198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb8107b30 0x7f5cb8198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/19894689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 msgr2=0x7f5cb8198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 0x7f5cb8198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/19894689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb81a8820 con 0x7f5cb8108480 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 0x7f5cb8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009fd0 tx=0x7f5cb000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5caeffd640 1 -- 172.21.15.16:0/19894689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0017070 con 0x7f5cb8108480 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5caeffd640 1 -- 172.21.15.16:0/19894689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb0003e20 con 0x7f5cb8108480 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5caeffd640 1 -- 172.21.15.16:0/19894689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0010460 con 0x7f5cb8108480 2024-09-21T00:47:00.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.678+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb81a8b10 con 0x7f5cb8108480 2024-09-21T00:47:00.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.679+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb81a8f40 con 0x7f5cb8108480 2024-09-21T00:47:00.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.683+0000 7f5caeffd640 1 -- 172.21.15.16:0/19894689 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5cb0003970 con 0x7f5cb8108480 2024-09-21T00:47:00.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5cc65cc740 1 Processor -- start 2024-09-21T00:47:00.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5caeffd640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 0x7f5ca40b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 0x7f5ca40b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5cc65cc740 1 -- start start 2024-09-21T00:47:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.684+0000 7f5caeffd640 1 -- 172.21.15.16:0/19894689 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5cb00e6ef0 con 0x7f5cb8108480 2024-09-21T00:47:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e139b1b0 0x5609e176b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e176bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57648/0 (socket says 172.21.15.16:57648) 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cbddf4640 1 -- 172.21.15.16:0/2075181131 learned_addr learned my addr 172.21.15.16:0/2075181131 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5609e16e1ea0 con 0x5609e13c4070 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5609e16d12d0 con 0x5609e13a3390 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5609e16d50e0 con 0x5609e139b1b0 2024-09-21T00:47:00.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.685+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e176bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/2075181131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e139b1b0 msgr2=0x5609e176b800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e139b1b0 0x5609e176b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/2075181131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 msgr2=0x5609e176b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/2075181131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e142f650 con 0x5609e13a3390 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e176bd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00e4ad0 tx=0x7f5cb00ac940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e4246dbc98e60f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 0x7f5ca40b8b70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000c00 tx=0x7f5ca8005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5ca3fff640 1 -- 172.21.15.16:0/2075181131 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020040 con 0x5609e13a3390 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5ca3fff640 1 -- 172.21.15.16:0/2075181131 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb00acc20 con 0x5609e13a3390 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.686+0000 7f5ca3fff640 1 -- 172.21.15.16:0/2075181131 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00abde0 con 0x5609e13a3390 2024-09-21T00:47:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 msgr2=0x5609e176bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e176bd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00e4ad0 tx=0x7f5cb00ac940 comp rx=0 tx=0).stop 2024-09-21T00:47:00.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 shutdown_connections 2024-09-21T00:47:00.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e176bd40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e139b1b0 0x5609e176b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/2075181131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 >> 172.21.15.16:0/2075181131 conn(0x5609e13b8460 msgr2=0x5609e17691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 shutdown_connections 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- 172.21.15.16:0/2075181131 wait complete. 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.688+0000 7f5cc65cc740 1 -- start start 2024-09-21T00:47:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.689+0000 7f5cc65cc740 1 Processor -- start 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.689+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.689+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e1776f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13c4070 0x5609e1782dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5609e1532700 con 0x5609e139b1b0 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5609e166c160 con 0x5609e13a3390 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5609e1779aa0 con 0x5609e13c4070 2024-09-21T00:47:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57662/0 (socket says 172.21.15.16:57662) 2024-09-21T00:47:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbddf4640 1 -- 172.21.15.16:0/1269372893 learned_addr learned my addr 172.21.15.16:0/1269372893 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cc65cc740 10 client.0 _ll_register_callbacks cb 0x5609e16859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e1776f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13c4070 0x5609e1782dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 -- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13c4070 msgr2=0x5609e1782dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13c4070 0x5609e1782dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 -- 172.21.15.16:0/1269372893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 msgr2=0x5609e1776a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbd5f3640 1 -- 172.21.15.16:0/1269372893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e1699c90 con 0x5609e13a3390 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.690+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.691+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e1776f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009230 tx=0x7f5ca8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60437d90dcc4e841 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.691+0000 7f5ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.691+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8035050 con 0x5609e13a3390 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.691+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5ca8004450 con 0x5609e13a3390 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.691+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cb00acc20 con 0x5609e13a3390 2024-09-21T00:47:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.692+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ca8031870 con 0x5609e13a3390 2024-09-21T00:47:00.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.692+0000 7f5cc65cc740 10 client.25238 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:00.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.692+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5609e1785840 con 0x5609e13a3390 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.692+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca804c070 con 0x5609e13a3390 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.692+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ca8004bc0 con 0x5609e13a3390 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 10 client.25238 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 10 client.25238 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 20 client.25238 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e13829f0 0x5609e1788d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 4 client.25238 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5cb00acc20 con 0x5609e13829f0 2024-09-21T00:47:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.693+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e13829f0 0x5609e1788d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5ca17fa640 10 client.25238 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e13829f0 0x5609e1788d50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b6698288b856506 server_cookie=cb0ed181c78134b5 in_seq=0 out_seq=0 2024-09-21T00:47:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5ca17fa640 1 -- 172.21.15.16:0/1269372893 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5cb00acc20 con 0x5609e13829f0 2024-09-21T00:47:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5ca17fa640 10 client.25238 handle_command_reply: tid=0 2024-09-21T00:47:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5cc65cc740 1 client.25238 shutdown 2024-09-21T00:47:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 msgr2=0x5609e1776f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.694+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e1776f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009230 tx=0x7f5ca8009260 comp rx=0 tx=0).stop 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 shutdown_connections 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e13829f0 0x5609e1788d50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13c4070 0x5609e1782dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e13a3390 0x5609e1776f90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/1269372893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e139b1b0 0x5609e1776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5ca17fa640 0 client.25238 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 >> 172.21.15.16:0/1269372893 conn(0x5609e13b8460 msgr2=0x5609e176e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 shutdown_connections 2024-09-21T00:47:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 1 -- 172.21.15.16:0/1269372893 wait complete. 2024-09-21T00:47:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.695+0000 7f5cc65cc740 20 client.25238 trim_cache size 0 max 16384 2024-09-21T00:47:00.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 Processor -- start 2024-09-21T00:47:00.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 -- start start 2024-09-21T00:47:00.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e17691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e1782cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81b14d0 con 0x5609e13c4070 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81b3010 con 0x5609e139b1b0 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.721+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81b1ba0 con 0x5609e13a3390 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbd5f3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e1782cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57678/0 (socket says 172.21.15.16:57678) 2024-09-21T00:47:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbd5f3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e1782cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:38012/0 (socket says 172.21.15.16:38012) 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/3198135505 learned_addr learned my addr 172.21.15.16:0/3198135505 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e17691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/3198135505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 msgr2=0x5609e1782cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e1782cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/3198135505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 msgr2=0x5609e17691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e17691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.722+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/3198135505 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e176d5b0 con 0x5609e13c4070 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.723+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a96e0 tx=0x7f5cb00acb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194ad7fa1c27f982 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.723+0000 7f5ca37fe640 1 -- 172.21.15.16:0/3198135505 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00d4030 con 0x5609e13c4070 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.723+0000 7f5ca37fe640 1 -- 172.21.15.16:0/3198135505 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb00acc20 con 0x5609e13c4070 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.723+0000 7f5ca37fe640 1 -- 172.21.15.16:0/3198135505 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020040 con 0x5609e13c4070 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 -- 172.21.15.16:0/3198135505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 msgr2=0x5609e176e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00a96e0 tx=0x7f5cb00acb10 comp rx=0 tx=0).stop 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 -- 172.21.15.16:0/3198135505 shutdown_connections 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e176e3c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e1782cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/3198135505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e17691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 -- 172.21.15.16:0/3198135505 >> 172.21.15.16:0/3198135505 conn(0x5609e13b8460 msgr2=0x5609e1768ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 -- 172.21.15.16:0/3198135505 shutdown_connections 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.724+0000 7f5cc65cc740 1 -- 172.21.15.16:0/3198135505 wait complete. 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.725+0000 7f5cc65cc740 1 -- start start 2024-09-21T00:47:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.725+0000 7f5cc65cc740 1 Processor -- start 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e177f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e177b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e177bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81b2940 con 0x5609e13c4070 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81b2270 con 0x5609e139b1b0 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81af4d0 con 0x5609e13a3390 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cc65cc740 10 client.0 _ll_register_callbacks cb 0x7f5cb4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.726+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e177f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e177bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbddf4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e177f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:45910/0 (socket says 172.21.15.16:45910) 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbddf4640 1 -- 172.21.15.16:0/836795023 learned_addr learned my addr 172.21.15.16:0/836795023 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbd5f3640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e177b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 msgr2=0x5609e177b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e177b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/836795023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 msgr2=0x5609e177f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e177f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 -- 172.21.15.16:0/836795023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e177c120 con 0x5609e13c4070 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5cbe5f5640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e177bbe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b760 tx=0x7f5cb00b1d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d0340dccd551d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.727+0000 7f5ca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0020030 con 0x5609e13c4070 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f5cb00983d0 con 0x5609e13c4070 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cb00acc20 con 0x5609e13c4070 2024-09-21T00:47:00.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5cb00a9760 con 0x5609e13c4070 2024-09-21T00:47:00.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5cc65cc740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:00.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.728+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5609e17fcb20 con 0x5609e13c4070 2024-09-21T00:47:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.729+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb00acc20 con 0x5609e13c4070 2024-09-21T00:47:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5cb00d0a90 con 0x5609e13c4070 2024-09-21T00:47:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 10 client.15570 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 20 client.15570 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e1357da0 0x5609e17feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 4 client.15570 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609e16e3df0 con 0x5609e1357da0 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.730+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e1357da0 0x5609e17feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5cbddf4640 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e1357da0 0x5609e17feda0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6fa954606d21802d server_cookie=e4e9f785654e5863 in_seq=0 out_seq=0 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5ca17fa640 10 client.15570 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5ca17fa640 1 -- 172.21.15.16:0/836795023 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609e16e3df0 con 0x5609e1357da0 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5ca17fa640 10 client.15570 handle_command_reply: tid=0 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5cc65cc740 1 client.15570 shutdown 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 msgr2=0x5609e177bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.731+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e177bbe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b760 tx=0x7f5cb00b1d70 comp rx=0 tx=0).stop 2024-09-21T00:47:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 shutdown_connections 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x5609e1357da0 0x5609e17feda0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5609e13c4070 0x5609e177bbe0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609e13a3390 0x5609e177b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5ca17fa640 0 client.15570 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 --2- 172.21.15.16:0/836795023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5609e139b1b0 0x5609e177f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 >> 172.21.15.16:0/836795023 conn(0x5609e13b8460 msgr2=0x5609e176e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 shutdown_connections 2024-09-21T00:47:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 1 -- 172.21.15.16:0/836795023 wait complete. 2024-09-21T00:47:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.732+0000 7f5cc65cc740 20 client.15570 trim_cache size 0 max 16384 2024-09-21T00:47:00.735 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 msgr2=0x7f5ca40b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 0x7f5ca40b8b70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000c00 tx=0x7f5ca8005f30 comp rx=0 tx=0).stop 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 msgr2=0x7f5cb8198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009fd0 tx=0x7f5cb000b260 comp rx=0 tx=0).stop 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 shutdown_connections 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f5ca40b6660 0x7f5ca40b8b70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5cb8108480 0x7f5cb8198ba0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb8107b30 0x7f5cb8198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 --2- 172.21.15.16:0/19894689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cb81021f0 0x7f5cb8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:00.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.734+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 >> 172.21.15.16:0/19894689 conn(0x7f5cb8077c60 msgr2=0x7f5cb8103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:00.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.736+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 shutdown_connections 2024-09-21T00:47:00.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:00.736+0000 7f5cc0058640 1 -- 172.21.15.16:0/19894689 wait complete. 2024-09-21T00:47:01.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:47:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:02.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:01 smithi016 ceph-mon[30947]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:47:02.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:01 smithi123 ceph-mon[34853]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:47:02.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:01 smithi178 ceph-mon[34888]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T00:47:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.335+0000 7fc9ae267640 1 -- 172.21.15.16:0/1007922985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 msgr2=0x7fc9a8106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.335+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1007922985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a8106260 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc998009900 tx=0x7fc99802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 -- 172.21.15.16:0/1007922985 shutdown_connections 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1007922985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 0x7fc9a8112910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1007922985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 0x7fc9a810bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1007922985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a8106260 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 -- 172.21.15.16:0/1007922985 >> 172.21.15.16:0/1007922985 conn(0x7fc9a8101880 msgr2=0x7fc9a8103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 -- 172.21.15.16:0/1007922985 shutdown_connections 2024-09-21T00:47:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.336+0000 7fc9ae267640 1 -- 172.21.15.16:0/1007922985 wait complete. 2024-09-21T00:47:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.337+0000 7fc9ae267640 1 Processor -- start 2024-09-21T00:47:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 -- start start 2024-09-21T00:47:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57704/0 (socket says 172.21.15.16:57704) 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9a7fff640 1 -- 172.21.15.16:0/1110348046 learned_addr learned my addr 172.21.15.16:0/1110348046 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 0x7fc9a819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 0x7fc9a81a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8115d50 con 0x7fc9a8105e50 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8115bd0 con 0x7fc9a810b790 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.338+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8115ed0 con 0x7fc9a810c0e0 2024-09-21T00:47:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9ac804640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 0x7fc9a81a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 0x7fc9a819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a7fff640 1 -- 172.21.15.16:0/1110348046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 msgr2=0x7fc9a81a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a7fff640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 0x7fc9a81a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a7fff640 1 -- 172.21.15.16:0/1110348046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 msgr2=0x7fc9a819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a7fff640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 0x7fc9a819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.339+0000 7fc9a7fff640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a81a2420 con 0x7fc9a8105e50 2024-09-21T00:47:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.340+0000 7fc9a7fff640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc998009850 tx=0x7fc998030a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.340+0000 7fc9a57fa640 1 -- 172.21.15.16:0/1110348046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99803f070 con 0x7fc9a8105e50 2024-09-21T00:47:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.340+0000 7fc9a57fa640 1 -- 172.21.15.16:0/1110348046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc998030e30 con 0x7fc9a8105e50 2024-09-21T00:47:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.340+0000 7fc9a57fa640 1 -- 172.21.15.16:0/1110348046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998035030 con 0x7fc9a8105e50 2024-09-21T00:47:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.341+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a81a26b0 con 0x7fc9a8105e50 2024-09-21T00:47:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.342+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81a2a50 con 0x7fc9a8105e50 2024-09-21T00:47:02.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.345+0000 7fc9b47db740 1 Processor -- start 2024-09-21T00:47:02.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 -- start start 2024-09-21T00:47:02.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9a57fa640 1 -- 172.21.15.16:0/1110348046 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc998042070 con 0x7fc9a8105e50 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec8781b0 0x5641ecc48800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc48d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5641ecbbeea0 con 0x5641ec8a1070 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5641ecbae2d0 con 0x5641ec880390 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.346+0000 7fc9b47db740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5641ecbb20e0 con 0x5641ec8781b0 2024-09-21T00:47:02.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc48d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57706/0 (socket says 172.21.15.16:57706) 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 -- 172.21.15.16:0/4133274742 learned_addr learned my addr 172.21.15.16:0/4133274742 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 -- 172.21.15.16:0/4133274742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec8781b0 msgr2=0x5641ecc48800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec8781b0 0x5641ecc48800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 -- 172.21.15.16:0/4133274742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 msgr2=0x5641ecc48d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc48d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.347+0000 7fc9ac804640 1 -- 172.21.15.16:0/4133274742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ec90c650 con 0x5641ec8a1070 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.348+0000 7fc9ac804640 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00103f0 tx=0x7fc9a00108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fcb7969b005e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.348+0000 7fc9a57fa640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 0x7fc9900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.348+0000 7fc9a57fa640 1 -- 172.21.15.16:0/1110348046 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc998107980 con 0x7fc9a8105e50 2024-09-21T00:47:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.348+0000 7fc9a7fff640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 0x7fc9900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.348+0000 7fc98e7fc640 1 -- 172.21.15.16:0/4133274742 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0016070 con 0x5641ec8a1070 2024-09-21T00:47:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.349+0000 7fc98e7fc640 1 -- 172.21.15.16:0/4133274742 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a0004d20 con 0x5641ec8a1070 2024-09-21T00:47:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.349+0000 7fc98e7fc640 1 -- 172.21.15.16:0/4133274742 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005440 con 0x5641ec8a1070 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 -- 172.21.15.16:0/4133274742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 msgr2=0x5641ecc482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9a7fff640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 0x7fc9900b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc998005f70 tx=0x7fc998003920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00103f0 tx=0x7fc9a00108b0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 -- 172.21.15.16:0/4133274742 shutdown_connections 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc48d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec8781b0 0x5641ecc48800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 --2- 172.21.15.16:0/4133274742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8a1070 0x5641ecc482c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 -- 172.21.15.16:0/4133274742 >> 172.21.15.16:0/4133274742 conn(0x5641ec895460 msgr2=0x5641ecc461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 -- 172.21.15.16:0/4133274742 shutdown_connections 2024-09-21T00:47:02.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.350+0000 7fc9b47db740 1 -- 172.21.15.16:0/4133274742 wait complete. 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.351+0000 7fc9b47db740 1 -- start start 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.351+0000 7fc9b47db740 1 Processor -- start 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.351+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec880390 0x5641ecc5d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec8a1070 0x5641ecc62090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5641eca0f700 con 0x5641ec8781b0 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57722/0 (socket says 172.21.15.16:57722) 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 -- 172.21.15.16:0/1847406276 learned_addr learned my addr 172.21.15.16:0/1847406276 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb49160 con 0x5641ec8a1070 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5641ecc56aa0 con 0x5641ec880390 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9b47db740 10 client.0 _ll_register_callbacks cb 0x5641ecb629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:02.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec880390 0x5641ecc5d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 -- 172.21.15.16:0/1847406276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec880390 msgr2=0x5641ecc5d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec880390 0x5641ecc5d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 -- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec8a1070 msgr2=0x5641ecc62090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec8a1070 0x5641ecc62090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ecb76c90 con 0x5641ec8781b0 2024-09-21T00:47:02.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9ac804640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005060 tx=0x7fc9a0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd1d38573e63d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.352+0000 7fc9877fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:02.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0029060 con 0x5641ec8781b0 2024-09-21T00:47:02.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc9a00051c0 con 0x5641ec8781b0 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a0004d20 con 0x5641ec8781b0 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc9a0016070 con 0x5641ec8781b0 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9b47db740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.353+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641ecc6afa0 con 0x5641ec8781b0 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.354+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a0004d20 con 0x5641ec8781b0 2024-09-21T00:47:02.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc9a000f040 con 0x5641ec8781b0 2024-09-21T00:47:02.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:02.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 10 client.15582 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-21T00:47:02.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 20 client.15582 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:02.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec85f9f0 0x5641ecc6e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 4 client.15582 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:02.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641ecbc0df0 con 0x5641ec85f9f0 2024-09-21T00:47:02.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.355+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec85f9f0 0x5641ecc6e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.356+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec85f9f0 0x5641ecc6e300 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=314a0f29252b12b5 server_cookie=d176669b22be6126 in_seq=0 out_seq=0 2024-09-21T00:47:02.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.356+0000 7fc9877fe640 10 client.15582 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:02.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9877fe640 1 -- 172.21.15.16:0/1847406276 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641ecbc0df0 con 0x5641ec85f9f0 2024-09-21T00:47:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9877fe640 10 client.15582 handle_command_reply: tid=0 2024-09-21T00:47:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 client.15582 shutdown 2024-09-21T00:47:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 msgr2=0x5641ecc5ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005060 tx=0x7fc9a0003970 comp rx=0 tx=0).stop 2024-09-21T00:47:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 shutdown_connections 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec85f9f0 0x5641ecc6e300 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9877fe640 0 client.15582 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec8a1070 0x5641ecc62090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec880390 0x5641ecc5d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1847406276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5ca90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.357+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 >> 172.21.15.16:0/1847406276 conn(0x5641ec895460 msgr2=0x5641ecc4b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.358+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 shutdown_connections 2024-09-21T00:47:02.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.358+0000 7fc9b47db740 1 -- 172.21.15.16:0/1847406276 wait complete. 2024-09-21T00:47:02.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.358+0000 7fc9b47db740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.384+0000 7fc9b47db740 1 Processor -- start 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.384+0000 7fc9b47db740 1 -- start start 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc5b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc45860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8070f60 con 0x5641ec8781b0 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8072aa0 con 0x5641ec880390 2024-09-21T00:47:02.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9b47db740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8071630 con 0x5641ec85f9f0 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57736/0 (socket says 172.21.15.16:57736) 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 -- 172.21.15.16:0/1534916179 learned_addr learned my addr 172.21.15.16:0/1534916179 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 -- 172.21.15.16:0/1534916179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 msgr2=0x5641ecc5b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc5b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 -- 172.21.15.16:0/1534916179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 msgr2=0x5641ecc45860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc45860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.385+0000 7fc9a77fe640 1 -- 172.21.15.16:0/1534916179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecc4c3d0 con 0x5641ec8781b0 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.386+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806aa90 tx=0x7fc99c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908c73d4a7e198bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.386+0000 7fc98dffb640 1 -- 172.21.15.16:0/1534916179 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c014e40 con 0x5641ec8781b0 2024-09-21T00:47:02.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.386+0000 7fc98dffb640 1 -- 172.21.15.16:0/1534916179 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c014110 con 0x5641ec8781b0 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.386+0000 7fc98dffb640 1 -- 172.21.15.16:0/1534916179 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c012740 con 0x5641ec8781b0 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 -- 172.21.15.16:0/1534916179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 msgr2=0x5641ecc5b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806aa90 tx=0x7fc99c014840 comp rx=0 tx=0).stop 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 -- 172.21.15.16:0/1534916179 shutdown_connections 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc45860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc5b650 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 --2- 172.21.15.16:0/1534916179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc5b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 -- 172.21.15.16:0/1534916179 >> 172.21.15.16:0/1534916179 conn(0x5641ec895460 msgr2=0x5641ecc56ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 -- 172.21.15.16:0/1534916179 shutdown_connections 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.387+0000 7fc9b47db740 1 -- 172.21.15.16:0/1534916179 wait complete. 2024-09-21T00:47:02.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.388+0000 7fc9b47db740 1 -- start start 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.388+0000 7fc9b47db740 1 Processor -- start 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9ac804640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:38058/0 (socket says 172.21.15.16:38058) 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57746/0 (socket says 172.21.15.16:57746) 2024-09-21T00:47:02.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9ac804640 1 -- 172.21.15.16:0/3751161981 learned_addr learned my addr 172.21.15.16:0/3751161981 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc64e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80723d0 con 0x5641ec8781b0 2024-09-21T00:47:02.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8071d00 con 0x5641ec880390 2024-09-21T00:47:02.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.389+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a806ef60 con 0x5641ec85f9f0 2024-09-21T00:47:02.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9ac804640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc64e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9a77fe640 1 -- 172.21.15.16:0/3751161981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 msgr2=0x5641ecc643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9a77fe640 1 -- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 msgr2=0x5641ecc64e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc64e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.390+0000 7fc9a77fe640 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641eccd7a70 con 0x5641ec8781b0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9a77fe640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806aa90 tx=0x7fc99c01e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff16e7b67535360c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9877fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9877fe640 1 -- 172.21.15.16:0/3751161981 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c021040 con 0x5641ec8781b0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9877fe640 1 -- 172.21.15.16:0/3751161981 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc99c012450 con 0x5641ec8781b0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9877fe640 10 client.0 inactive, discarding osd_map(75..75 src has 1..75) 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9b47db740 10 client.0 _ll_register_callbacks cb 0x7fc9a0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.391+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99c014110 con 0x5641ec8781b0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9877fe640 1 -- 172.21.15.16:0/3751161981 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc99c012650 con 0x5641ec8781b0 2024-09-21T00:47:02.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:02.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5641eccd8920 con 0x5641ec8781b0 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9877fe640 1 -- 172.21.15.16:0/3751161981 <== mon.0 v2:172.21.15.16:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc99c02d070 con 0x5641ec8781b0 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 10 client.15588 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 20 client.15588 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec8a1070 0x5641eccdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 4 client.15588 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.392+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641ecbbc8a0 con 0x5641ec8a1070 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9ac804640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec8a1070 0x5641eccdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9877fe640 10 client.15588 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9ac804640 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec8a1070 0x5641eccdb080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2293a7b30d7fb982 server_cookie=d4f5dcb35f051152 in_seq=0 out_seq=0 2024-09-21T00:47:02.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9877fe640 1 -- 172.21.15.16:0/3751161981 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641ecbbc8a0 con 0x5641ec8a1070 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9877fe640 10 client.15588 handle_command_reply: tid=0 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.393+0000 7fc9b47db740 1 client.15588 shutdown 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 msgr2=0x5641ecc64920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc9a806aa90 tx=0x7fc99c01e9d0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 shutdown_connections 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x5641ec8a1070 0x5641eccdb080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5641ec880390 0x5641ecc64e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9877fe640 0 client.15588 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641ec8781b0 0x5641ecc64920 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 --2- 172.21.15.16:0/3751161981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5641ec85f9f0 0x5641ecc643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 >> 172.21.15.16:0/3751161981 conn(0x5641ec895460 msgr2=0x5641ecc44750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.397 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:02.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 shutdown_connections 2024-09-21T00:47:02.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 1 -- 172.21.15.16:0/3751161981 wait complete. 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.394+0000 7fc9b47db740 20 client.15588 trim_cache size 0 max 16384 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 msgr2=0x7fc9900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 0x7fc9900b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc998005f70 tx=0x7fc998003920 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 msgr2=0x7fc9a819c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc998009850 tx=0x7fc998030a10 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 shutdown_connections 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.395+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc9900b6590 0x7fc9900b8aa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9a810c0e0 0x7fc9a81a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a810b790 0x7fc9a819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 --2- 172.21.15.16:0/1110348046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9a8105e50 0x7fc9a819c4b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 >> 172.21.15.16:0/1110348046 conn(0x7fc9a8101880 msgr2=0x7fc9a81095a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 shutdown_connections 2024-09-21T00:47:02.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:02.396+0000 7fc9ae267640 1 -- 172.21.15.16:0/1110348046 wait complete. 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.488+0000 7f2327d69640 1 -- 172.21.15.16:0/2704647080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 msgr2=0x7f232010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.488+0000 7f2327d69640 1 --2- 172.21.15.16:0/2704647080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f232010a980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2318009be0 tx=0x7f231802a6c0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 -- 172.21.15.16:0/2704647080 shutdown_connections 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 --2- 172.21.15.16:0/2704647080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f232010a980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 --2- 172.21.15.16:0/2704647080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2320103640 0x7f2320103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 --2- 172.21.15.16:0/2704647080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23201025c0 0x7f2320102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 -- 172.21.15.16:0/2704647080 >> 172.21.15.16:0/2704647080 conn(0x7f23200fdf00 msgr2=0x7f23201003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 -- 172.21.15.16:0/2704647080 shutdown_connections 2024-09-21T00:47:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.489+0000 7f2327d69640 1 -- 172.21.15.16:0/2704647080 wait complete. 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 Processor -- start 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 -- start start 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23201025c0 0x7f2320197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f2320198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f232010d140 con 0x7f2320103640 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f232010cfc0 con 0x7f23201025c0 2024-09-21T00:47:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2327d69640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f232010d2c0 con 0x7f2320103fe0 2024-09-21T00:47:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2325304640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2325304640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57752/0 (socket says 172.21.15.16:57752) 2024-09-21T00:47:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2325304640 1 -- 172.21.15.16:0/563528136 learned_addr learned my addr 172.21.15.16:0/563528136 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2325b05640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23201025c0 0x7f2320197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.490+0000 7f2326306640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f2320198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 -- 172.21.15.16:0/563528136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 msgr2=0x7f2320198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f2320198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 -- 172.21.15.16:0/563528136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23201025c0 msgr2=0x7f2320197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23201025c0 0x7f2320197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 -- 172.21.15.16:0/563528136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23201996f0 con 0x7f2320103640 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2325304640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f231000b780 tx=0x7f2310010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2316ffd640 1 -- 172.21.15.16:0/563528136 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231000eb40 con 0x7f2320103640 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2316ffd640 1 -- 172.21.15.16:0/563528136 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2310022070 con 0x7f2320103640 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2316ffd640 1 -- 172.21.15.16:0/563528136 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310014370 con 0x7f2320103640 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23201999e0 con 0x7f2320103640 2024-09-21T00:47:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.491+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23201a00d0 con 0x7f2320103640 2024-09-21T00:47:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.495+0000 7f232ecdc740 1 Processor -- start 2024-09-21T00:47:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.495+0000 7f232ecdc740 1 -- start start 2024-09-21T00:47:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x5557797354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x555779736010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5557796a76f0 con 0x55577938d1b0 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555779696b20 con 0x55577936c4d0 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f232ecdc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55577969a930 con 0x5557793642f0 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f2326306640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f2326306640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57766/0 (socket says 172.21.15.16:57766) 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f2326306640 1 -- 172.21.15.16:0/2026906732 learned_addr learned my addr 172.21.15.16:0/2026906732 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.496+0000 7f2316ffd640 1 -- 172.21.15.16:0/563528136 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2310009390 con 0x7f2320103640 2024-09-21T00:47:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x5557797354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 -- 172.21.15.16:0/2026906732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 msgr2=0x555779736010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x555779736010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 -- 172.21.15.16:0/2026906732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 msgr2=0x555779734e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 -- 172.21.15.16:0/2026906732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577965c530 con 0x5557793642f0 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2325b05640 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x5557797354c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f231c005fd0 tx=0x7f231c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d62da62d455927a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f2326306640 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.497+0000 7f230bfff640 1 -- 172.21.15.16:0/2026906732 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c004020 con 0x5557793642f0 2024-09-21T00:47:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.498+0000 7f230bfff640 1 -- 172.21.15.16:0/2026906732 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f231c0041c0 con 0x5557793642f0 2024-09-21T00:47:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.498+0000 7f230bfff640 1 -- 172.21.15.16:0/2026906732 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c019740 con 0x5557793642f0 2024-09-21T00:47:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.498+0000 7f2316ffd640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 0x7f230c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.498+0000 7f2326306640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 0x7f230c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.498+0000 7f2316ffd640 1 -- 172.21.15.16:0/563528136 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f23100efde0 con 0x7f2320103640 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 -- 172.21.15.16:0/2026906732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 msgr2=0x5557797354c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x5557797354c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f231c005fd0 tx=0x7f231c011810 comp rx=0 tx=0).stop 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f2326306640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 0x7f230c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2318009420 tx=0x7f23180308a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 -- 172.21.15.16:0/2026906732 shutdown_connections 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x555779736010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x5557797354c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 --2- 172.21.15.16:0/2026906732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x555779734e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 -- 172.21.15.16:0/2026906732 >> 172.21.15.16:0/2026906732 conn(0x555779381300 msgr2=0x5557797308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 -- 172.21.15.16:0/2026906732 shutdown_connections 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.499+0000 7f232ecdc740 1 -- 172.21.15.16:0/2026906732 wait complete. 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 -- start start 2024-09-21T00:47:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 Processor -- start 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x55577973ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5557795ceab0 con 0x55577938d1b0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55577963c730 con 0x55577936c4d0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555779736b30 con 0x5557793642f0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.500+0000 7f232ecdc740 10 client.0 _ll_register_callbacks cb 0x5557796906b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2326306640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:38096/0 (socket says 172.21.15.16:38096) 2024-09-21T00:47:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 -- 172.21.15.16:0/1677037028 learned_addr learned my addr 172.21.15.16:0/1677037028 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2326306640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57770/0 (socket says 172.21.15.16:57770) 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325304640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x55577973ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 -- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 msgr2=0x55577973ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x55577973ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 -- 172.21.15.16:0/1677037028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 msgr2=0x55577973f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 -- 172.21.15.16:0/1677037028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557793f8790 con 0x5557793642f0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2326306640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f2325b05640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70a64ff3ab2b94d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.501+0000 7f23097fa640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c029020 con 0x5557793642f0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f231c005240 con 0x5557793642f0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231c0041c0 con 0x5557793642f0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f231c034050 con 0x5557793642f0 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f232ecdc740 10 client.25291 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555779471620 con 0x5557793642f0 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f231c0041c0 con 0x5557793642f0 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.502+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f231c019510 con 0x5557793642f0 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 10 client.25291 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 10 client.25291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 20 client.25291 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577934bd80 0x55577974bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 4 client.25291 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557796a9640 con 0x55577934bd80 2024-09-21T00:47:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.503+0000 7f2325304640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577934bd80 0x55577974bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.504+0000 7f23097fa640 10 client.25291 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.504+0000 7f2325304640 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577934bd80 0x55577974bbd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35b523a6b79b7daa server_cookie=96f99bebdef33ca0 in_seq=0 out_seq=0 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.504+0000 7f23097fa640 1 -- 172.21.15.16:0/1677037028 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557796a9640 con 0x55577934bd80 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.504+0000 7f23097fa640 10 client.25291 handle_command_reply: tid=0 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.504+0000 7f232ecdc740 1 client.25291 shutdown 2024-09-21T00:47:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 msgr2=0x55577973e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c009980 comp rx=0 tx=0).stop 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 shutdown_connections 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577934bd80 0x55577974bbd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577938d1b0 0x55577973f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f23097fa640 0 client.25291 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577936c4d0 0x55577973ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 --2- 172.21.15.16:0/1677037028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577973e5d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 >> 172.21.15.16:0/1677037028 conn(0x555779381300 msgr2=0x55577972eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 shutdown_connections 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 1 -- 172.21.15.16:0/1677037028 wait complete. 2024-09-21T00:47:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.505+0000 7f232ecdc740 20 client.25291 trim_cache size 0 max 16384 2024-09-21T00:47:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.534+0000 7f232ecdc740 1 Processor -- start 2024-09-21T00:47:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 -- start start 2024-09-21T00:47:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577972fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577936c4d0 0x5557797466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23201a8c50 con 0x55577936c4d0 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23201aa790 con 0x55577934bd80 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f232ecdc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23201a9320 con 0x5557793642f0 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f2325b05640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f2325b05640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:45990/0 (socket says 172.21.15.16:45990) 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f2325b05640 1 -- 172.21.15.16:0/781104918 learned_addr learned my addr 172.21.15.16:0/781104918 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f2326306640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577936c4d0 0x5557797466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.535+0000 7f2325304640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577972fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 -- 172.21.15.16:0/781104918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 msgr2=0x55577972fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577972fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 -- 172.21.15.16:0/781104918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577936c4d0 msgr2=0x5557797466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577936c4d0 0x5557797466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 -- 172.21.15.16:0/781104918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577974c130 con 0x55577934bd80 2024-09-21T00:47:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325304640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577972fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f2325b05640 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f231c009530 tx=0x7f231c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24cf92d0dc25205 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f230b7fe640 1 -- 172.21.15.16:0/781104918 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c000e60 con 0x55577934bd80 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f230b7fe640 1 -- 172.21.15.16:0/781104918 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f231c019430 con 0x55577934bd80 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.536+0000 7f230b7fe640 1 -- 172.21.15.16:0/781104918 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c029040 con 0x55577934bd80 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- 172.21.15.16:0/781104918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 msgr2=0x55577972f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f231c009530 tx=0x7f231c011810 comp rx=0 tx=0).stop 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- 172.21.15.16:0/781104918 shutdown_connections 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55577936c4d0 0x5557797466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5557793642f0 0x55577972fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 --2- 172.21.15.16:0/781104918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x55577972f610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- 172.21.15.16:0/781104918 >> 172.21.15.16:0/781104918 conn(0x555779381300 msgr2=0x55577972b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- 172.21.15.16:0/781104918 shutdown_connections 2024-09-21T00:47:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- 172.21.15.16:0/781104918 wait complete. 2024-09-21T00:47:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 -- start start 2024-09-21T00:47:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.538+0000 7f232ecdc740 1 Processor -- start 2024-09-21T00:47:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x555779741520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577936c4d0 0x555779742750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23201aa0c0 con 0x5557793642f0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23201a99f0 con 0x55577934bd80 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23201a6c50 con 0x55577936c4d0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57784/0 (socket says 172.21.15.16:57784) 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 -- 172.21.15.16:0/3554172421 learned_addr learned my addr 172.21.15.16:0/3554172421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f232ecdc740 10 client.0 _ll_register_callbacks cb 0x7f231c009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325b05640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x555779741520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2326306640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577936c4d0 0x555779742750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 -- 172.21.15.16:0/3554172421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577936c4d0 msgr2=0x555779742750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577936c4d0 0x555779742750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 -- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 msgr2=0x555779741520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x555779741520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.539+0000 7f2325304640 1 -- 172.21.15.16:0/3554172421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555779742eb0 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f2325304640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f23100b5d00 tx=0x7f231009d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77936b53808a8389 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f23097fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100bde60 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f23100b2270 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231c019430 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23100baae0 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f232ecdc740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555779746280 con 0x5557793642f0 2024-09-21T00:47:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.540+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23100bfa20 con 0x5557793642f0 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2310065100 con 0x5557793642f0 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 20 client.15606 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577938d1b0 0x5557797b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 4 client.15606 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f231c019430 con 0x55577938d1b0 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f2325b05640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577938d1b0 0x5557797b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f23097fa640 10 client.15606 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.542+0000 7f2325b05640 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577938d1b0 0x5557797b85a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ed82b09a8830098 server_cookie=68a271b0df2423bd in_seq=0 out_seq=0 2024-09-21T00:47:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f23097fa640 1 -- 172.21.15.16:0/3554172421 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f231c019430 con 0x55577938d1b0 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f23097fa640 10 client.15606 handle_command_reply: tid=0 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 client.15606 shutdown 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 msgr2=0x555779741be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f23100b5d00 tx=0x7f231009d040 comp rx=0 tx=0).stop 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 shutdown_connections 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55577938d1b0 0x5557797b85a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f23097fa640 0 client.15606 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577936c4d0 0x555779742750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5557793642f0 0x555779741be0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 --2- 172.21.15.16:0/3554172421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55577934bd80 0x555779741520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.550+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 >> 172.21.15.16:0/3554172421 conn(0x555779381300 msgr2=0x555779734df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 shutdown_connections 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f232ecdc740 1 -- 172.21.15.16:0/3554172421 wait complete. 2024-09-21T00:47:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f232ecdc740 20 client.15606 trim_cache size 0 max 16384 2024-09-21T00:47:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:47:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:47:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:47:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 msgr2=0x7f230c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 0x7f230c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2318009420 tx=0x7f23180308a0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 msgr2=0x7f2320198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.551+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f231000b780 tx=0x7f2310010f60 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 shutdown_connections 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f230c0b6590 0x7f230c0b8aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2320103fe0 0x7f2320198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320103640 0x7f2320198320 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 --2- 172.21.15.16:0/563528136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23201025c0 0x7f2320197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 >> 172.21.15.16:0/563528136 conn(0x7f23200fdf00 msgr2=0x7f2320106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 shutdown_connections 2024-09-21T00:47:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:02.552+0000 7f2327d69640 1 -- 172.21.15.16:0/563528136 wait complete. 2024-09-21T00:47:03.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:47:03.505 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:03.912 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:03 smithi016 ceph-mon[30947]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 -- 172.21.15.16:0/2272028164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481083a0 msgr2=0x7fa2481087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 --2- 172.21.15.16:0/2272028164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481083a0 0x7fa2481087b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009900 tx=0x7fa23c02a410 comp rx=0 tx=0).stop 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 -- 172.21.15.16:0/2272028164 shutdown_connections 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 --2- 172.21.15.16:0/2272028164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa248108cf0 0x7fa24810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 --2- 172.21.15.16:0/2272028164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481083a0 0x7fa2481087b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 --2- 172.21.15.16:0/2272028164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa248102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 -- 172.21.15.16:0/2272028164 >> 172.21.15.16:0/2272028164 conn(0x7fa248079730 msgr2=0x7fa248079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 -- 172.21.15.16:0/2272028164 shutdown_connections 2024-09-21T00:47:04.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.107+0000 7fa24d389640 1 -- 172.21.15.16:0/2272028164 wait complete. 2024-09-21T00:47:04.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.108+0000 7fa24d389640 1 Processor -- start 2024-09-21T00:47:04.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 -- start start 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa24819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2481083a0 0x7fa24819b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 0x7fa24819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa248112960 con 0x7fa248108cf0 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481127e0 con 0x7fa248102a60 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa24d389640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa248112ae0 con 0x7fa2481083a0 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa24819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 0x7fa24819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 0x7fa24819bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57806/0 (socket says 172.21.15.16:57806) 2024-09-21T00:47:04.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.109+0000 7fa2477fe640 1 -- 172.21.15.16:0/3352930565 learned_addr learned my addr 172.21.15.16:0/3352930565 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:04.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa2467fc640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2481083a0 0x7fa24819b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 -- 172.21.15.16:0/3352930565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2481083a0 msgr2=0x7fa24819b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2481083a0 0x7fa24819b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 -- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 msgr2=0x7fa24819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 0x7fa24819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 -- 172.21.15.16:0/3352930565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481a6520 con 0x7fa248102a60 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.110+0000 7fa246ffd640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa24819b210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e9f0 tx=0x7fa23800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.111+0000 7fa22ffff640 1 -- 172.21.15.16:0/3352930565 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23800ccc0 con 0x7fa248102a60 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.111+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2481a6810 con 0x7fa248102a60 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.111+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481a6da0 con 0x7fa248102a60 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.111+0000 7fa22ffff640 1 -- 172.21.15.16:0/3352930565 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2380108e0 con 0x7fa248102a60 2024-09-21T00:47:04.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.111+0000 7fa22ffff640 1 -- 172.21.15.16:0/3352930565 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238018880 con 0x7fa248102a60 2024-09-21T00:47:04.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.114+0000 7fa2538fd740 1 Processor -- start 2024-09-21T00:47:04.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.114+0000 7fa2538fd740 1 -- start start 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdee7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb1f390 0x560afdee8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560afde5dea0 con 0x560afdb171b0 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560afde4d2d0 con 0x560afdb40070 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:46036/0 (socket says 172.21.15.16:46036) 2024-09-21T00:47:04.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2477fe640 1 -- 172.21.15.16:0/2791940600 learned_addr learned my addr 172.21.15.16:0/2791940600 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:04.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560afde510e0 con 0x560afdb1f390 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa22ffff640 1 -- 172.21.15.16:0/3352930565 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa238010430 con 0x7fa248102a60 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.115+0000 7fa2467fc640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb1f390 0x560afdee8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa246ffd640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdee7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 -- 172.21.15.16:0/2791940600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb1f390 msgr2=0x560afdee8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb1f390 0x560afdee8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 -- 172.21.15.16:0/2791940600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 msgr2=0x560afdee7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdee7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 -- 172.21.15.16:0/2791940600 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560afdbab650 con 0x560afdb40070 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa246ffd640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdee7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa2477fe640 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2400114c0 tx=0x7fa240011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a109b158028ffdd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.116+0000 7fa22d7fa640 1 -- 172.21.15.16:0/2791940600 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240004b20 con 0x560afdb40070 2024-09-21T00:47:04.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.117+0000 7fa22d7fa640 1 -- 172.21.15.16:0/2791940600 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa240004cc0 con 0x560afdb40070 2024-09-21T00:47:04.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.117+0000 7fa22d7fa640 1 -- 172.21.15.16:0/2791940600 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240005410 con 0x560afdb40070 2024-09-21T00:47:04.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.117+0000 7fa22ffff640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 0x7fa2300b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.117+0000 7fa246ffd640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 0x7fa2300b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.117+0000 7fa22ffff640 1 -- 172.21.15.16:0/3352930565 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa238018620 con 0x7fa248102a60 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 msgr2=0x560afdee76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2400114c0 tx=0x7fa240011980 comp rx=0 tx=0).stop 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 shutdown_connections 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb1f390 0x560afdee8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdee7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 --2- 172.21.15.16:0/2791940600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdee76a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 >> 172.21.15.16:0/2791940600 conn(0x560afdb34460 msgr2=0x560afdee5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 shutdown_connections 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa246ffd640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 0x7fa2300b8ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa2380aa640 tx=0x7fa238000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.118+0000 7fa2538fd740 1 -- 172.21.15.16:0/2791940600 wait complete. 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 -- start start 2024-09-21T00:47:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 Processor -- start 2024-09-21T00:47:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb1f390 0x560afdef7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdef7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560afdcae700 con 0x560afdb1f390 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560afdde8160 con 0x560afdb40070 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560afdefa120 con 0x560afdb171b0 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2538fd740 10 client.0 _ll_register_callbacks cb 0x560afde019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb1f390 0x560afdef7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:38136/0 (socket says 172.21.15.16:38136) 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.119+0000 7fa2477fe640 1 -- 172.21.15.16:0/1218808228 learned_addr learned my addr 172.21.15.16:0/1218808228 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdef7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 -- 172.21.15.16:0/1218808228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 msgr2=0x560afdef7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdef7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 -- 172.21.15.16:0/1218808228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb1f390 msgr2=0x560afdef7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb1f390 0x560afdef7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 -- 172.21.15.16:0/1218808228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560afde15c90 con 0x560afdb171b0 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa24000fde0 tx=0x7fa240009d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cd1c6162d033268 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa22aff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.120+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24001d070 con 0x560afdb171b0 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa240019bc0 con 0x560afdb171b0 2024-09-21T00:47:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa240004cc0 con 0x560afdb171b0 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa240019dc0 con 0x560afdb171b0 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa2538fd740 10 client.25309 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560afdf05d80 con 0x560afdb171b0 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.121+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24002d070 con 0x560afdb171b0 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa240031400 con 0x560afdb171b0 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 10 client.25309 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 10 client.25309 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T00:47:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 20 client.25309 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdafe9f0 0x560afdf09190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 4 client.25309 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa240004cc0 con 0x560afdafe9f0 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.122+0000 7fa2467fc640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdafe9f0 0x560afdf09190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.123+0000 7fa2467fc640 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdafe9f0 0x560afdf09190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b91282c9f84afe1 server_cookie=447967236ae005f3 in_seq=0 out_seq=0 2024-09-21T00:47:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.123+0000 7fa22aff5640 10 client.25309 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa22aff5640 1 -- 172.21.15.16:0/1218808228 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa240004cc0 con 0x560afdafe9f0 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa22aff5640 10 client.25309 handle_command_reply: tid=0 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 client.25309 shutdown 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 msgr2=0x560afdef7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa24000fde0 tx=0x7fa240009d90 comp rx=0 tx=0).stop 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 shutdown_connections 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb40070 0x560afdef7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdafe9f0 0x560afdf09190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb1f390 0x560afdef7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1218808228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdef7020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa22aff5640 0 client.25309 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 >> 172.21.15.16:0/1218808228 conn(0x560afdb34460 msgr2=0x560afdee9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 shutdown_connections 2024-09-21T00:47:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.124+0000 7fa2538fd740 1 -- 172.21.15.16:0/1218808228 wait complete. 2024-09-21T00:47:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.125+0000 7fa2538fd740 20 client.25309 trim_cache size 0 max 16384 2024-09-21T00:47:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.150+0000 7fa2538fd740 1 Processor -- start 2024-09-21T00:47:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 -- start start 2024-09-21T00:47:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdef74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdef74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdef7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400e2f0 con 0x560afdb171b0 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400fe30 con 0x560afdb1f390 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2538fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400e9c0 con 0x560afdafe9f0 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:58702/0 (socket says 172.21.15.16:58702) 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.151+0000 7fa2477fe640 1 -- 172.21.15.16:0/1076419313 learned_addr learned my addr 172.21.15.16:0/1076419313 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdef7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 -- 172.21.15.16:0/1076419313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 msgr2=0x560afdef7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdef7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 -- 172.21.15.16:0/1076419313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 msgr2=0x560afdef74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdef74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 -- 172.21.15.16:0/1076419313 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560afdeea460 con 0x560afdafe9f0 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2467fc640 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdef74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa2477fe640 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa240004a70 tx=0x7fa240009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268d0c46d20e4ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.152+0000 7fa22cff9640 1 -- 172.21.15.16:0/1076419313 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24001d070 con 0x560afdafe9f0 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa22cff9640 1 -- 172.21.15.16:0/1076419313 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24002d040 con 0x560afdafe9f0 2024-09-21T00:47:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa22cff9640 1 -- 172.21.15.16:0/1076419313 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240031660 con 0x560afdafe9f0 2024-09-21T00:47:04.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 -- 172.21.15.16:0/1076419313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 msgr2=0x560afdef8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa240004a70 tx=0x7fa240009500 comp rx=0 tx=0).stop 2024-09-21T00:47:04.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 -- 172.21.15.16:0/1076419313 shutdown_connections 2024-09-21T00:47:04.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdef7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdb171b0 0x560afdef74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 --2- 172.21.15.16:0/1076419313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdafe9f0 0x560afdef8f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.153+0000 7fa2538fd740 1 -- 172.21.15.16:0/1076419313 >> 172.21.15.16:0/1076419313 conn(0x560afdb34460 msgr2=0x560afdef6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.154+0000 7fa2538fd740 1 -- 172.21.15.16:0/1076419313 shutdown_connections 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.154+0000 7fa2538fd740 1 -- 172.21.15.16:0/1076419313 wait complete. 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.154+0000 7fa2538fd740 1 -- start start 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.154+0000 7fa2538fd740 1 Processor -- start 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.154+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 0x560afdeffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdefb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400f760 con 0x560afdafe9f0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400f090 con 0x560afdb1f390 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa23400c2d0 con 0x560afdb171b0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2538fd740 10 client.0 _ll_register_callbacks cb 0x7fa240019640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 0x560afdeffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:58718/0 (socket says 172.21.15.16:58718) 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 -- 172.21.15.16:0/765454911 learned_addr learned my addr 172.21.15.16:0/765454911 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2477fe640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 0x560afdeffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45784/0 (socket says 172.21.15.16:45784) 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2477fe640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdefb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 -- 172.21.15.16:0/765454911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 msgr2=0x560afdefb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdefb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 -- 172.21.15.16:0/765454911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 msgr2=0x560afdeffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 0x560afdeffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2467fc640 1 -- 172.21.15.16:0/765454911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560afdefbb60 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.155+0000 7fa2477fe640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdefb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa2467fc640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009850 tx=0x7fa23c032c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45341482a78e02ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa22aff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c035050 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fa23c031c50 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24002d040 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa23c0318a0 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa2538fd740 10 client.25315 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.156+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560afdf73790 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24002d040 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa23c0054c0 con 0x560afdb171b0 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 10 client.25315 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:04.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 10 client.25315 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T00:47:04.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 20 client.25315 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:04.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdb40070 0x560afdf75fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:04.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 4 client.25315 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:04.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.157+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560afde5fdf0 con 0x560afdb40070 2024-09-21T00:47:04.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa2477fe640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdb40070 0x560afdf75fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa22aff5640 10 client.25315 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa2477fe640 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdb40070 0x560afdf75fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ec46609e4fe04b2 server_cookie=2b6599c0890ca2f5 in_seq=0 out_seq=0 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa22aff5640 1 -- 172.21.15.16:0/765454911 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560afde5fdf0 con 0x560afdb40070 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa22aff5640 10 client.25315 handle_command_reply: tid=0 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.158+0000 7fa2538fd740 1 client.25315 shutdown 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 msgr2=0x560afdefafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009850 tx=0x7fa23c032c80 comp rx=0 tx=0).stop 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 shutdown_connections 2024-09-21T00:47:04.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560afdb1f390 0x560afdefb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560afdb171b0 0x560afdefafb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x560afdb40070 0x560afdf75fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 --2- 172.21.15.16:0/765454911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560afdafe9f0 0x560afdeffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 >> 172.21.15.16:0/765454911 conn(0x560afdb34460 msgr2=0x560afdee8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa22aff5640 0 client.25315 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 shutdown_connections 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 1 -- 172.21.15.16:0/765454911 wait complete. 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.159+0000 7fa2538fd740 20 client.25315 trim_cache size 0 max 16384 2024-09-21T00:47:04.164 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:04.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 msgr2=0x7fa2300b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 0x7fa2300b8ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa2380aa640 tx=0x7fa238000bc0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 msgr2=0x7fa24819b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa24819b210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e9f0 tx=0x7fa23800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 shutdown_connections 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fa2300b6790 0x7fa2300b8ca0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248108cf0 0x7fa24819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2481083a0 0x7fa24819b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 --2- 172.21.15.16:0/3352930565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa248102a60 0x7fa24819b210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 >> 172.21.15.16:0/3352930565 conn(0x7fa248079730 msgr2=0x7fa248104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 shutdown_connections 2024-09-21T00:47:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:04.160+0000 7fa24d389640 1 -- 172.21.15.16:0/3352930565 wait complete. 2024-09-21T00:47:04.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:03 smithi123 ceph-mon[34853]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:47:04.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:03 smithi178 ceph-mon[34888]: pgmap v373: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T00:47:04.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:47:05.165 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.663+0000 7fdd29375640 1 -- 172.21.15.16:0/3069851273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24104690 msgr2=0x7fdd24104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.663+0000 7fdd29375640 1 --2- 172.21.15.16:0/3069851273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24104690 0x7fdd24104aa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009900 tx=0x7fdd1402a410 comp rx=0 tx=0).stop 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.663+0000 7fdd29375640 1 -- 172.21.15.16:0/3069851273 shutdown_connections 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.663+0000 7fdd29375640 1 --2- 172.21.15.16:0/3069851273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24102890 0x7fdd24112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.663+0000 7fdd29375640 1 --2- 172.21.15.16:0/3069851273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24101da0 0x7fdd241021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.664+0000 7fdd29375640 1 --2- 172.21.15.16:0/3069851273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24104690 0x7fdd24104aa0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.664+0000 7fdd29375640 1 -- 172.21.15.16:0/3069851273 >> 172.21.15.16:0/3069851273 conn(0x7fdd24077c60 msgr2=0x7fdd240780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.664+0000 7fdd29375640 1 -- 172.21.15.16:0/3069851273 shutdown_connections 2024-09-21T00:47:05.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.664+0000 7fdd29375640 1 -- 172.21.15.16:0/3069851273 wait complete. 2024-09-21T00:47:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.664+0000 7fdd29375640 1 Processor -- start 2024-09-21T00:47:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 -- start start 2024-09-21T00:47:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24102890 0x7fdd2419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24104690 0x7fdd241a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24115c80 con 0x7fdd24101da0 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24115b00 con 0x7fdd24104690 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd29375640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24115e00 con 0x7fdd24102890 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45800/0 (socket says 172.21.15.16:45800) 2024-09-21T00:47:05.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd22ffd640 1 -- 172.21.15.16:0/3586178917 learned_addr learned my addr 172.21.15.16:0/3586178917 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd237fe640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24104690 0x7fdd241a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.665+0000 7fdd227fc640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24102890 0x7fdd2419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 -- 172.21.15.16:0/3586178917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24102890 msgr2=0x7fdd2419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24102890 0x7fdd2419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 -- 172.21.15.16:0/3586178917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24104690 msgr2=0x7fdd241a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24104690 0x7fdd241a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 -- 172.21.15.16:0/3586178917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd241a2600 con 0x7fdd24101da0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdd14005940 tx=0x7fdd140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd0bfff640 1 -- 172.21.15.16:0/3586178917 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1403f030 con 0x7fdd24101da0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd241a2890 con 0x7fdd24101da0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd0bfff640 1 -- 172.21.15.16:0/3586178917 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd14003cb0 con 0x7fdd24101da0 2024-09-21T00:47:05.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.666+0000 7fdd0bfff640 1 -- 172.21.15.16:0/3586178917 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14035070 con 0x7fdd24101da0 2024-09-21T00:47:05.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.667+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd241a9050 con 0x7fdd24101da0 2024-09-21T00:47:05.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.669+0000 7fdd2f8e9740 1 Processor -- start 2024-09-21T00:47:05.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 -- start start 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b768be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3a0390 0x559a8b769120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a8b6deea0 con 0x559a8b3981b0 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559a8b6ce2d0 con 0x559a8b3c1070 2024-09-21T00:47:05.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a8b6d20e0 con 0x559a8b3a0390 2024-09-21T00:47:05.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:42784/0 (socket says 172.21.15.16:42784) 2024-09-21T00:47:05.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd237fe640 1 -- 172.21.15.16:0/385663912 learned_addr learned my addr 172.21.15.16:0/385663912 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.670+0000 7fdd227fc640 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3a0390 0x559a8b769120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 -- 172.21.15.16:0/385663912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3a0390 msgr2=0x559a8b769120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3a0390 0x559a8b769120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 -- 172.21.15.16:0/385663912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 msgr2=0x559a8b768be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b768be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 -- 172.21.15.16:0/385663912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8b42c650 con 0x559a8b3c1070 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd237fe640 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c010370 tx=0x7fdd1c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c127950396b53421 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.671+0000 7fdd097fa640 1 -- 172.21.15.16:0/385663912 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c016070 con 0x559a8b3c1070 2024-09-21T00:47:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.672+0000 7fdd097fa640 1 -- 172.21.15.16:0/385663912 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd1c004d20 con 0x559a8b3c1070 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.672+0000 7fdd0bfff640 1 -- 172.21.15.16:0/3586178917 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdd14042030 con 0x7fdd24101da0 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd097fa640 1 -- 172.21.15.16:0/385663912 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c005390 con 0x559a8b3c1070 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/385663912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 msgr2=0x559a8b7686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c010370 tx=0x7fdd1c010830 comp rx=0 tx=0).stop 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/385663912 shutdown_connections 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3a0390 0x559a8b769120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b768be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/385663912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b7686a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.673+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/385663912 >> 172.21.15.16:0/385663912 conn(0x559a8b3b5460 msgr2=0x559a8b766590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.674+0000 7fdd0bfff640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 0x7fdd0c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.674+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/385663912 shutdown_connections 2024-09-21T00:47:05.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.674+0000 7fdd0bfff640 1 -- 172.21.15.16:0/3586178917 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdd14107a80 con 0x7fdd24101da0 2024-09-21T00:47:05.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.675+0000 7fdd227fc640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 0x7fdd0c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.676+0000 7fdd227fc640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 0x7fdd0c0b8b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd24104de0 tx=0x7fdd1800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.676+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/385663912 wait complete. 2024-09-21T00:47:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.677+0000 7fdd2f8e9740 1 -- start start 2024-09-21T00:47:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.677+0000 7fdd2f8e9740 1 Processor -- start 2024-09-21T00:47:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 0x559a8b773cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 0x559a8b773cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 0x559a8b773cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:58746/0 (socket says 172.21.15.16:58746) 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd227fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.678+0000 7fdd227fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45804/0 (socket says 172.21.15.16:45804) 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd22ffd640 1 -- 172.21.15.16:0/4095857838 learned_addr learned my addr 172.21.15.16:0/4095857838 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b774740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a8b52f700 con 0x559a8b3a0390 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559a8b669160 con 0x559a8b3c1070 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a8b776ed0 con 0x559a8b3981b0 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd237fe640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b774740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd227fc640 1 -- 172.21.15.16:0/4095857838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 msgr2=0x559a8b773cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd227fc640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 0x559a8b773cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd227fc640 1 -- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 msgr2=0x559a8b774740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd227fc640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b774740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd227fc640 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8b696c90 con 0x559a8b3a0390 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.679+0000 7fdd237fe640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b774740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd227fc640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdd24075ab0 tx=0x7fdd18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da241d8c09929eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd06ff5640 1 -- 172.21.15.16:0/4095857838 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1802c060 con 0x559a8b3a0390 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd2f8e9740 10 client.0 _ll_register_callbacks cb 0x559a8b6829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd1c004d20 con 0x559a8b3a0390 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.680+0000 7fdd06ff5640 1 -- 172.21.15.16:0/4095857838 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdd18017030 con 0x559a8b3a0390 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.681+0000 7fdd06ff5640 1 -- 172.21.15.16:0/4095857838 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd1801fd40 con 0x559a8b3a0390 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.681+0000 7fdd2f8e9740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.681+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559a8b782920 con 0x559a8b3a0390 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.682+0000 7fdd06ff5640 1 -- 172.21.15.16:0/4095857838 <== mon.0 v2:172.21.15.16:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd18011440 con 0x559a8b3a0390 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.682+0000 7fdd2f8e9740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.682+0000 7fdd2f8e9740 10 client.15630 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.682+0000 7fdd2f8e9740 20 client.15630 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.683+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b37f9f0 0x559a8b785e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.683+0000 7fdd2f8e9740 4 client.15630 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.683+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a8b6e0df0 con 0x559a8b37f9f0 2024-09-21T00:47:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.684+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b37f9f0 0x559a8b785e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.684+0000 7fdd06ff5640 10 client.15630 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.684+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b37f9f0 0x559a8b785e20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2b205e2a07c55a4 server_cookie=2a450104077805d0 in_seq=0 out_seq=0 2024-09-21T00:47:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd06ff5640 1 -- 172.21.15.16:0/4095857838 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a8b6e0df0 con 0x559a8b37f9f0 2024-09-21T00:47:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd06ff5640 10 client.15630 handle_command_reply: tid=0 2024-09-21T00:47:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 client.15630 shutdown 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 msgr2=0x559a8b774200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdd24075ab0 tx=0x7fdd18004730 comp rx=0 tx=0).stop 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 shutdown_connections 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b37f9f0 0x559a8b785e20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd06ff5640 0 client.15630 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3c1070 0x559a8b774740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3a0390 0x559a8b774200 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/4095857838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3981b0 0x559a8b773cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.685+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 >> 172.21.15.16:0/4095857838 conn(0x559a8b3b5460 msgr2=0x559a8b76b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.686+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 shutdown_connections 2024-09-21T00:47:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.686+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/4095857838 wait complete. 2024-09-21T00:47:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.686+0000 7fdd2f8e9740 20 client.15630 trim_cache size 0 max 16384 2024-09-21T00:47:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.713+0000 7fdd2f8e9740 1 Processor -- start 2024-09-21T00:47:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 -- start start 2024-09-21T00:47:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b77f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 0x559a8b77fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241b13d0 con 0x559a8b3981b0 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241b2f10 con 0x559a8b3a0390 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241b1aa0 con 0x559a8b3c1070 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd22ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45812/0 (socket says 172.21.15.16:45812) 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd22ffd640 1 -- 172.21.15.16:0/2796452415 learned_addr learned my addr 172.21.15.16:0/2796452415 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.714+0000 7fdd227fc640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b77f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd237fe640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 0x559a8b77fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 -- 172.21.15.16:0/2796452415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 msgr2=0x559a8b77fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 0x559a8b77fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 -- 172.21.15.16:0/2796452415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 msgr2=0x559a8b77f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b77f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 -- 172.21.15.16:0/2796452415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8b767320 con 0x559a8b3981b0 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd237fe640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 0x559a8b77fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd227fc640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b77f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.715+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdd14031440 tx=0x7fdd140f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92f4257969eae86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.716+0000 7fdd08ff9640 1 -- 172.21.15.16:0/2796452415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14049040 con 0x559a8b3981b0 2024-09-21T00:47:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.716+0000 7fdd08ff9640 1 -- 172.21.15.16:0/2796452415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd140d2070 con 0x559a8b3981b0 2024-09-21T00:47:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.716+0000 7fdd08ff9640 1 -- 172.21.15.16:0/2796452415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd140c9f20 con 0x559a8b3981b0 2024-09-21T00:47:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/2796452415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 msgr2=0x559a8b775ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdd14031440 tx=0x7fdd140f1040 comp rx=0 tx=0).stop 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/2796452415 shutdown_connections 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b3c1070 0x559a8b77fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b77f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/2796452415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3981b0 0x559a8b775ba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/2796452415 >> 172.21.15.16:0/2796452415 conn(0x559a8b3b5460 msgr2=0x559a8b77f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.717+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/2796452415 shutdown_connections 2024-09-21T00:47:05.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.718+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/2796452415 wait complete. 2024-09-21T00:47:05.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.718+0000 7fdd2f8e9740 1 -- start start 2024-09-21T00:47:05.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.718+0000 7fdd2f8e9740 1 Processor -- start 2024-09-21T00:47:05.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b7781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 0x559a8b778710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 0x559a8b778c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241b2840 con 0x559a8b3c1070 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241b2170 con 0x559a8b3a0390 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241af3b0 con 0x559a8b354da0 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd2f8e9740 10 client.0 _ll_register_callbacks cb 0x7fdd18004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd227fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 0x559a8b778710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd227fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 0x559a8b778710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45820/0 (socket says 172.21.15.16:45820) 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd227fc640 1 -- 172.21.15.16:0/1658582815 learned_addr learned my addr 172.21.15.16:0/1658582815 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 0x559a8b778c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b7781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 -- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 msgr2=0x559a8b7781d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b7781d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 -- 172.21.15.16:0/1658582815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 msgr2=0x559a8b778710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:05.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 0x559a8b778710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.719+0000 7fdd237fe640 1 -- 172.21.15.16:0/1658582815 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8b7f8080 con 0x559a8b354da0 2024-09-21T00:47:05.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd237fe640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 0x559a8b778c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c000f80 tx=0x7fdd1c0127b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694bc928b7d99375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c029070 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd140d2070 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fdd1c003970 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd1c016040 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd2f8e9740 10 client.25330 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.720+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a8b7f9270 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd140d2070 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd1c02c030 con 0x559a8b354da0 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 10 client.25330 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:05.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 10 client.25330 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 20 client.25330 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b7f9880 0x559a8b7fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 4 client.25330 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a8b6dc8a0 con 0x559a8b7f9880 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.721+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b7f9880 0x559a8b7fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd06ff5640 10 client.25330 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd22ffd640 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b7f9880 0x559a8b7fbca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28e3715b34c1028b server_cookie=abb0a1b783d262d8 in_seq=0 out_seq=0 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd06ff5640 1 -- 172.21.15.16:0/1658582815 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a8b6dc8a0 con 0x559a8b7f9880 2024-09-21T00:47:05.726 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:05.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd06ff5640 10 client.25330 handle_command_reply: tid=0 2024-09-21T00:47:05.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 client.25330 shutdown 2024-09-21T00:47:05.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 msgr2=0x559a8b778c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 0x559a8b778c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c000f80 tx=0x7fdd1c0127b0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 shutdown_connections 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x559a8b7f9880 0x559a8b7fbca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a8b354da0 0x559a8b778c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a8b3c1070 0x559a8b778710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd06ff5640 0 client.25330 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 --2- 172.21.15.16:0/1658582815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559a8b3a0390 0x559a8b7781d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 >> 172.21.15.16:0/1658582815 conn(0x559a8b3b5460 msgr2=0x559a8b77faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.722+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 shutdown_connections 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.723+0000 7fdd2f8e9740 1 -- 172.21.15.16:0/1658582815 wait complete. 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.723+0000 7fdd2f8e9740 20 client.25330 trim_cache size 0 max 16384 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.723+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 msgr2=0x7fdd0c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.723+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 0x7fdd0c0b8b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd24104de0 tx=0x7fdd1800b390 comp rx=0 tx=0).stop 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 msgr2=0x7fdd2419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdd14005940 tx=0x7fdd140042f0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 shutdown_connections 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fdd0c0b6610 0x7fdd0c0b8b20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd24104690 0x7fdd241a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd24102890 0x7fdd2419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 --2- 172.21.15.16:0/3586178917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd24101da0 0x7fdd2419c690 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 >> 172.21.15.16:0/3586178917 conn(0x7fdd24077c60 msgr2=0x7fdd240ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 shutdown_connections 2024-09-21T00:47:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:05.724+0000 7fdd29375640 1 -- 172.21.15.16:0/3586178917 wait complete. 2024-09-21T00:47:06.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:05 smithi016 ceph-mon[30947]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T00:47:06.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:05 smithi123 ceph-mon[34853]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T00:47:06.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:05 smithi178 ceph-mon[34888]: pgmap v374: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T00:47:06.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:47:06.868 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:07.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 -- 172.21.15.16:0/3925408137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938102a80 msgr2=0x7f3938102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 --2- 172.21.15.16:0/3925408137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938102a80 0x7f3938102e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3934009900 tx=0x7f393402a410 comp rx=0 tx=0).stop 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 -- 172.21.15.16:0/3925408137 shutdown_connections 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 --2- 172.21.15.16:0/3925408137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938108d10 0x7f393810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 --2- 172.21.15.16:0/3925408137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39381083c0 0x7f39381087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 --2- 172.21.15.16:0/3925408137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938102a80 0x7f3938102e90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.445+0000 7f393ff38640 1 -- 172.21.15.16:0/3925408137 >> 172.21.15.16:0/3925408137 conn(0x7f3938079740 msgr2=0x7f3938079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.446+0000 7f393ff38640 1 -- 172.21.15.16:0/3925408137 shutdown_connections 2024-09-21T00:47:07.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.446+0000 7f393ff38640 1 -- 172.21.15.16:0/3925408137 wait complete. 2024-09-21T00:47:07.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 Processor -- start 2024-09-21T00:47:07.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 -- start start 2024-09-21T00:47:07.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 0x7f3938199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39381083c0 0x7f3938199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39381129d0 con 0x7f3938108d10 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3938112850 con 0x7f39381083c0 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.447+0000 7f393ff38640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3938112b50 con 0x7f3938102a80 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393e4d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 0x7f3938199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393e4d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45852/0 (socket says 172.21.15.16:45852) 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393e4d5640 1 -- 172.21.15.16:0/1751601226 learned_addr learned my addr 172.21.15.16:0/1751601226 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393d4d3640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39381083c0 0x7f3938199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 -- 172.21.15.16:0/1751601226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39381083c0 msgr2=0x7f3938199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39381083c0 0x7f3938199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 -- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 msgr2=0x7f393819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393dcd4640 1 -- 172.21.15.16:0/1751601226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393819f2c0 con 0x7f3938102a80 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.448+0000 7f393e4d5640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f393dcd4640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 0x7f3938199380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f393402aa00 tx=0x7f3934003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f392effd640 1 -- 172.21.15.16:0/1751601226 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393403f070 con 0x7f3938102a80 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393819f550 con 0x7f3938102a80 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f392effd640 1 -- 172.21.15.16:0/1751601226 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3934031b50 con 0x7f3938102a80 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f392effd640 1 -- 172.21.15.16:0/1751601226 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934035030 con 0x7f3938102a80 2024-09-21T00:47:07.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.449+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393806b820 con 0x7f3938102a80 2024-09-21T00:47:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.453+0000 7f39464ac740 1 Processor -- start 2024-09-21T00:47:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.453+0000 7f39464ac740 1 -- start start 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.453+0000 7f39464ac740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.453+0000 7f39464ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.453+0000 7f39464ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3e1390 0x56083d7aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f39464ac740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56083d71fea0 con 0x56083d402070 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f39464ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56083d70f2d0 con 0x56083d3e1390 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f39464ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56083d7130e0 con 0x56083d3d91b0 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45854/0 (socket says 172.21.15.16:45854) 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 -- 172.21.15.16:0/3091258921 learned_addr learned my addr 172.21.15.16:0/3091258921 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393d4d3640 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3e1390 0x56083d7aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 -- 172.21.15.16:0/3091258921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 msgr2=0x56083d7a9be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7a9be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 -- 172.21.15.16:0/3091258921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3e1390 msgr2=0x56083d7aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3e1390 0x56083d7aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.454+0000 7f393e4d5640 1 -- 172.21.15.16:0/3091258921 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083d46d650 con 0x56083d402070 2024-09-21T00:47:07.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.455+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3930009e20 tx=0x7f3930014c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba157d5a495e57ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.455+0000 7f3923fff640 1 -- 172.21.15.16:0/3091258921 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930012a60 con 0x56083d402070 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.455+0000 7f3923fff640 1 -- 172.21.15.16:0/3091258921 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3930023070 con 0x56083d402070 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.455+0000 7f3923fff640 1 -- 172.21.15.16:0/3091258921 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300148e0 con 0x56083d402070 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.456+0000 7f392effd640 1 -- 172.21.15.16:0/1751601226 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3934042070 con 0x7f3938102a80 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.456+0000 7f39464ac740 1 -- 172.21.15.16:0/3091258921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 msgr2=0x56083d7a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.456+0000 7f39464ac740 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3930009e20 tx=0x7f3930014c60 comp rx=0 tx=0).stop 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 -- 172.21.15.16:0/3091258921 shutdown_connections 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3e1390 0x56083d7aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 --2- 172.21.15.16:0/3091258921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d402070 0x56083d7a96a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 -- 172.21.15.16:0/3091258921 >> 172.21.15.16:0/3091258921 conn(0x56083d3f6460 msgr2=0x56083d7a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f392effd640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 0x7f39240b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f393d4d3640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 0x7f39240b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f392effd640 1 -- 172.21.15.16:0/1751601226 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f3934107800 con 0x7f3938102a80 2024-09-21T00:47:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.457+0000 7f39464ac740 1 -- 172.21.15.16:0/3091258921 shutdown_connections 2024-09-21T00:47:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.458+0000 7f39464ac740 1 -- 172.21.15.16:0/3091258921 wait complete. 2024-09-21T00:47:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.458+0000 7f393d4d3640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 0x7f39240b8a50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3938100b90 tx=0x7f3928005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.459+0000 7f39464ac740 1 -- start start 2024-09-21T00:47:07.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.459+0000 7f39464ac740 1 Processor -- start 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56083d570700 con 0x56083d3e1390 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56083d6aa160 con 0x56083d402070 2024-09-21T00:47:07.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f393d4d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f393d4d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45864/0 (socket says 172.21.15.16:45864) 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f393d4d3640 1 -- 172.21.15.16:0/3605232535 learned_addr learned my addr 172.21.15.16:0/3605232535 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.460+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56083d7b7e20 con 0x56083d3d91b0 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f39464ac740 10 client.0 _ll_register_callbacks cb 0x56083d6c39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 -- 172.21.15.16:0/3605232535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 msgr2=0x56083d7b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 -- 172.21.15.16:0/3605232535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 msgr2=0x56083d7b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 -- 172.21.15.16:0/3605232535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083d6d7c90 con 0x56083d402070 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393d4d3640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7c1140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3930009e20 tx=0x7f3930012d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c82154f4e833cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.461+0000 7f39217fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300142d0 con 0x56083d402070 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f3930014470 con 0x56083d402070 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3930023070 con 0x56083d402070 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3930031430 con 0x56083d402070 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39464ac740 10 client.25313 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.462+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56083d7c3b50 con 0x56083d402070 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f393003b8c0 con 0x56083d402070 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f393003a050 con 0x56083d402070 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 10 client.25313 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 10 client.25313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 20 client.25313 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d3c09f0 0x56083d7c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 4 client.25313 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3930023070 con 0x56083d3c09f0 2024-09-21T00:47:07.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.463+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d3c09f0 0x56083d7c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.464+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d3c09f0 0x56083d7c6f10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f47be1f412dab0 server_cookie=bc7775f31be68166 in_seq=0 out_seq=0 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.464+0000 7f39217fa640 10 client.25313 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39217fa640 1 -- 172.21.15.16:0/3605232535 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3930023070 con 0x56083d3c09f0 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39217fa640 10 client.25313 handle_command_reply: tid=0 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 client.25313 shutdown 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 msgr2=0x56083d7c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7c1140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3930009e20 tx=0x7f3930012d10 comp rx=0 tx=0).stop 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 shutdown_connections 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d3c09f0 0x56083d7c6f10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7c1140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 --2- 172.21.15.16:0/3605232535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3d91b0 0x56083d7b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 >> 172.21.15.16:0/3605232535 conn(0x56083d3f6460 msgr2=0x56083d7ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39217fa640 0 client.25313 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 shutdown_connections 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 1 -- 172.21.15.16:0/3605232535 wait complete. 2024-09-21T00:47:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.465+0000 7f39464ac740 20 client.25313 trim_cache size 0 max 16384 2024-09-21T00:47:07.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 Processor -- start 2024-09-21T00:47:07.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 -- start start 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d402070 0x56083d7b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39381ad0b0 con 0x56083d3e1390 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39381aebf0 con 0x56083d3d91b0 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.492+0000 7f39464ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39381ad780 con 0x56083d402070 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393d4d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:42840/0 (socket says 172.21.15.16:42840) 2024-09-21T00:47:07.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 -- 172.21.15.16:0/3571393038 learned_addr learned my addr 172.21.15.16:0/3571393038 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393e4d5640 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d402070 0x56083d7b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 -- 172.21.15.16:0/3571393038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d402070 msgr2=0x56083d7b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d402070 0x56083d7b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 -- 172.21.15.16:0/3571393038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 msgr2=0x56083d7b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.493+0000 7f393dcd4640 1 -- 172.21.15.16:0/3571393038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083d7ac500 con 0x56083d3d91b0 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.494+0000 7f393dcd4640 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f393402a9d0 tx=0x7f3934031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab8bd238233aa13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.494+0000 7f39237fe640 1 -- 172.21.15.16:0/3571393038 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934049040 con 0x56083d3d91b0 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.494+0000 7f39237fe640 1 -- 172.21.15.16:0/3571393038 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39340f10d0 con 0x56083d3d91b0 2024-09-21T00:47:07.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.494+0000 7f39237fe640 1 -- 172.21.15.16:0/3571393038 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340c9d40 con 0x56083d3d91b0 2024-09-21T00:47:07.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 -- 172.21.15.16:0/3571393038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 msgr2=0x56083d7b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f393402a9d0 tx=0x7f3934031400 comp rx=0 tx=0).stop 2024-09-21T00:47:07.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 -- 172.21.15.16:0/3571393038 shutdown_connections 2024-09-21T00:47:07.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d402070 0x56083d7b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3e1390 0x56083d7b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 --2- 172.21.15.16:0/3571393038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d3d91b0 0x56083d7b6cb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 -- 172.21.15.16:0/3571393038 >> 172.21.15.16:0/3571393038 conn(0x56083d3f6460 msgr2=0x56083d7ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 -- 172.21.15.16:0/3571393038 shutdown_connections 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.495+0000 7f39464ac740 1 -- 172.21.15.16:0/3571393038 wait complete. 2024-09-21T00:47:07.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 -- start start 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 Processor -- start 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 0x56083d7bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39381ae520 con 0x56083d3d91b0 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39381ade50 con 0x56083d402070 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.496+0000 7f39464ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39381ab0b0 con 0x56083d3e1390 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f39464ac740 10 client.0 _ll_register_callbacks cb 0x7f39280097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45880/0 (socket says 172.21.15.16:45880) 2024-09-21T00:47:07.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 -- 172.21.15.16:0/2305116232 learned_addr learned my addr 172.21.15.16:0/2305116232 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:07.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393e4d5640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393d4d3640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 0x56083d7bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 -- 172.21.15.16:0/2305116232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 msgr2=0x56083d7bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 0x56083d7bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 -- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 msgr2=0x56083d7bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:07.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7bb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 -- 172.21.15.16:0/2305116232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083d7c7370 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393d4d3640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 0x56083d7bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.497+0000 7f393dcd4640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3934031fb0 tx=0x7f39340c9300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34228e5040d10d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39217fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934049040 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39340f10d0 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f39340c9d40 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39340cd5e0 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39464ac740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56083d8317b0 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.498+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39340f10d0 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39340d6fb0 con 0x56083d3d91b0 2024-09-21T00:47:07.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 20 client.15654 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d395da0 0x56083d833e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 4 client.15654 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56083d721df0 con 0x56083d395da0 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.499+0000 7f393d4d3640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d395da0 0x56083d833e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39217fa640 10 client.15654 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f393d4d3640 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d395da0 0x56083d833e70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8df8cd6f5b105e7 server_cookie=f6d9d28951b70797 in_seq=0 out_seq=0 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39217fa640 1 -- 172.21.15.16:0/2305116232 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56083d721df0 con 0x56083d395da0 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39217fa640 10 client.15654 handle_command_reply: tid=0 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 client.15654 shutdown 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 msgr2=0x56083d7bdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3934031fb0 tx=0x7f39340c9300 comp rx=0 tx=0).stop 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 shutdown_connections 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x56083d395da0 0x56083d833e70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56083d402070 0x56083d7bb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083d3e1390 0x56083d7bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 --2- 172.21.15.16:0/2305116232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56083d3d91b0 0x56083d7bdaa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 >> 172.21.15.16:0/2305116232 conn(0x56083d3f6460 msgr2=0x56083d7ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39217fa640 0 client.15654 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.500+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 shutdown_connections 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f39464ac740 1 -- 172.21.15.16:0/2305116232 wait complete. 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f39464ac740 20 client.15654 trim_cache size 0 max 16384 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 msgr2=0x7f39240b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 0x7f39240b8a50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3938100b90 tx=0x7f3928005f90 comp rx=0 tx=0).stop 2024-09-21T00:47:07.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 msgr2=0x7f3938199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 0x7f3938199380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f393402aa00 tx=0x7f3934003b90 comp rx=0 tx=0).stop 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 shutdown_connections 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39240b6540 0x7f39240b8a50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3938108d10 0x7f393819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39381083c0 0x7f3938199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 --2- 172.21.15.16:0/1751601226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938102a80 0x7f3938199380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.501+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 >> 172.21.15.16:0/1751601226 conn(0x7f3938079740 msgr2=0x7f39381013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.502+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 shutdown_connections 2024-09-21T00:47:07.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:07.502+0000 7f393ff38640 1 -- 172.21.15.16:0/1751601226 wait complete. 2024-09-21T00:47:08.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:07 smithi016 ceph-mon[30947]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:47:08.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:07 smithi123 ceph-mon[34853]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:47:08.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:07 smithi178 ceph-mon[34888]: pgmap v375: 97 pgs: 97 active+clean; 676 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T00:47:09.332 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:47:09.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:47:09.618 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:10.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:09 smithi016 ceph-mon[30947]: pgmap v376: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.149+0000 7f6482b06640 1 -- 172.21.15.16:0/1111981866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c101d70 msgr2=0x7f647c102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.149+0000 7f6482b06640 1 --2- 172.21.15.16:0/1111981866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c101d70 0x7f647c102180 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6468009900 tx=0x7f646802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 -- 172.21.15.16:0/1111981866 shutdown_connections 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 --2- 172.21.15.16:0/1111981866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c102890 0x7f647c112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 --2- 172.21.15.16:0/1111981866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c101d70 0x7f647c102180 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 --2- 172.21.15.16:0/1111981866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 0x7f647c104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 -- 172.21.15.16:0/1111981866 >> 172.21.15.16:0/1111981866 conn(0x7f647c077c60 msgr2=0x7f647c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 -- 172.21.15.16:0/1111981866 shutdown_connections 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.150+0000 7f6482b06640 1 -- 172.21.15.16:0/1111981866 wait complete. 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.151+0000 7f6482b06640 1 Processor -- start 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.151+0000 7f6482b06640 1 -- start start 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.151+0000 7f6482b06640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c101d70 0x7f647c19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.151+0000 7f6482b06640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.151+0000 7f6482b06640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 0x7f647c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f6482b06640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c115c90 con 0x7f647c102890 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f6482b06640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f647c115b10 con 0x7f647c101d70 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f6482b06640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f647c115e10 con 0x7f647c104660 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f647bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f647bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45890/0 (socket says 172.21.15.16:45890) 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f647bfff640 1 -- 172.21.15.16:0/3340388811 learned_addr learned my addr 172.21.15.16:0/3340388811 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f64810a3640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 0x7f647c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.152+0000 7f64808a2640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c101d70 0x7f647c19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 -- 172.21.15.16:0/3340388811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 msgr2=0x7f647c1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 0x7f647c1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 -- 172.21.15.16:0/3340388811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c101d70 msgr2=0x7f647c19c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c101d70 0x7f647c19c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 -- 172.21.15.16:0/3340388811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c1a23e0 con 0x7f647c102890 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.153+0000 7f647bfff640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6468009850 tx=0x7f64680305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.154+0000 7f6479ffb640 1 -- 172.21.15.16:0/3340388811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646803f070 con 0x7f647c102890 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.154+0000 7f6479ffb640 1 -- 172.21.15.16:0/3340388811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6468004460 con 0x7f647c102890 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.154+0000 7f6479ffb640 1 -- 172.21.15.16:0/3340388811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6468035030 con 0x7f647c102890 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.154+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c1a2670 con 0x7f647c102890 2024-09-21T00:47:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.154+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1a2b00 con 0x7f647c102890 2024-09-21T00:47:10.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.157+0000 7f6479ffb640 1 -- 172.21.15.16:0/3340388811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6468042070 con 0x7f647c102890 2024-09-21T00:47:10.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.158+0000 7f648907a740 1 Processor -- start 2024-09-21T00:47:10.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.158+0000 7f6479ffb640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 0x7f646c0b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f64810a3640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 0x7f646c0b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f6479ffb640 1 -- 172.21.15.16:0/3340388811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f6468107560 con 0x7f647c102890 2024-09-21T00:47:10.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 -- start start 2024-09-21T00:47:10.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631067180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x5596310676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559630fd4e60 con 0x559630c8e490 2024-09-21T00:47:10.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559630fc4290 con 0x559630c96670 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.159+0000 7f648907a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559630fc80a0 con 0x559630cb7350 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f64808a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f64808a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:58826/0 (socket says 172.21.15.16:58826) 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f64808a2640 1 -- 172.21.15.16:0/232080933 learned_addr learned my addr 172.21.15.16:0/232080933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f64810a3640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 0x7f646c0b8bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6474005fd0 tx=0x7f6474009540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 -- 172.21.15.16:0/232080933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 msgr2=0x559631066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 -- 172.21.15.16:0/232080933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 msgr2=0x5596310676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x5596310676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f647bfff640 1 -- 172.21.15.16:0/232080933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559630d22930 con 0x559630c8e490 2024-09-21T00:47:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.160+0000 7f64808a2640 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.161+0000 7f647bfff640 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631067180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6468105050 tx=0x7f6468004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301e49e9e894d04c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.161+0000 7f6466ffd640 1 -- 172.21.15.16:0/232080933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64680d21c0 con 0x559630c8e490 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.161+0000 7f6466ffd640 1 -- 172.21.15.16:0/232080933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64680d7100 con 0x559630c8e490 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- 172.21.15.16:0/232080933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 msgr2=0x559631067180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631067180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6468105050 tx=0x7f6468004610 comp rx=0 tx=0).stop 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- 172.21.15.16:0/232080933 shutdown_connections 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x5596310676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631067180 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 --2- 172.21.15.16:0/232080933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630cb7350 0x559631066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- 172.21.15.16:0/232080933 >> 172.21.15.16:0/232080933 conn(0x559630cab740 msgr2=0x559631064b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- 172.21.15.16:0/232080933 shutdown_connections 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- 172.21.15.16:0/232080933 wait complete. 2024-09-21T00:47:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.162+0000 7f648907a740 1 -- start start 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 Processor -- start 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631072790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630cb7350 0x55963107e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559630e25890 con 0x559630cb7350 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559630f5ed40 con 0x559630c96670 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5596310751e0 con 0x559630c8e490 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f648907a740 10 client.0 _ll_register_callbacks cb 0x559630fc2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f64810a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630cb7350 0x55963107e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f647bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f647bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:42870/0 (socket says 172.21.15.16:42870) 2024-09-21T00:47:10.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f647bfff640 1 -- 172.21.15.16:0/2864411005 learned_addr learned my addr 172.21.15.16:0/2864411005 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:10.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.163+0000 7f64808a2640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 -- 172.21.15.16:0/2864411005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 msgr2=0x559631072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 -- 172.21.15.16:0/2864411005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630cb7350 msgr2=0x55963107e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630cb7350 0x55963107e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 -- 172.21.15.16:0/2864411005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963105bba0 con 0x559630c96670 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f647bfff640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f646802a450 tx=0x7f6468009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca7116cc6362f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f645bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:47:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64680d21c0 con 0x559630c96670 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f64681070e0 con 0x559630c96670 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.164+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64680d7100 con 0x559630c96670 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64681072e0 con 0x559630c96670 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 10 client.25328 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55963105e4d0 con 0x559630c96670 2024-09-21T00:47:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64680c9030 con 0x559630c96670 2024-09-21T00:47:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64680cc540 con 0x559630c96670 2024-09-21T00:47:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 10 client.25328 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 10 client.25328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 20 client.25328 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630c75cd0 0x5596310618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 4 client.25328 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f64680d7100 con 0x559630c75cd0 2024-09-21T00:47:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.165+0000 7f64808a2640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630c75cd0 0x5596310618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.166+0000 7f645bfff640 10 client.25328 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.166+0000 7f64808a2640 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630c75cd0 0x5596310618e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c8141b4e204adb server_cookie=76da25e27c739d21 in_seq=0 out_seq=0 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f645bfff640 1 -- 172.21.15.16:0/2864411005 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f64680d7100 con 0x559630c75cd0 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f645bfff640 10 client.25328 handle_command_reply: tid=0 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 client.25328 shutdown 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 msgr2=0x559631072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f646802a450 tx=0x7f6468009290 comp rx=0 tx=0).stop 2024-09-21T00:47:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 shutdown_connections 2024-09-21T00:47:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630c75cd0 0x5596310618e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f645bfff640 0 client.25328 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630cb7350 0x55963107e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631072cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 --2- 172.21.15.16:0/2864411005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 >> 172.21.15.16:0/2864411005 conn(0x559630cab740 msgr2=0x559631069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 shutdown_connections 2024-09-21T00:47:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 1 -- 172.21.15.16:0/2864411005 wait complete. 2024-09-21T00:47:10.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.167+0000 7f648907a740 20 client.25328 trim_cache size 0 max 16384 2024-09-21T00:47:10.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.185+0000 7f648907a740 1 Processor -- start 2024-09-21T00:47:10.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.185+0000 7f648907a740 1 -- start start 2024-09-21T00:47:10.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 0x559631064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c96670 0x559631071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c070ff0 con 0x559630c8e490 2024-09-21T00:47:10.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f647c072b30 con 0x559630c75cd0 2024-09-21T00:47:10.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f648907a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0716c0 con 0x559630c96670 2024-09-21T00:47:10.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f647bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f647bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45926/0 (socket says 172.21.15.16:45926) 2024-09-21T00:47:10.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f647bfff640 1 -- 172.21.15.16:0/3862017420 learned_addr learned my addr 172.21.15.16:0/3862017420 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:10.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 0x559631064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64810a3640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c96670 0x559631071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 -- 172.21.15.16:0/3862017420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c96670 msgr2=0x559631071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c96670 0x559631071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 -- 172.21.15.16:0/3862017420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 msgr2=0x559631071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.186+0000 7f64808a2640 1 -- 172.21.15.16:0/3862017420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559631069aa0 con 0x559630c75cd0 2024-09-21T00:47:10.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.187+0000 7f647bfff640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:10.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.187+0000 7f64808a2640 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 0x559631064ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6470000c00 tx=0x7f6470005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95513471b77f477 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.187+0000 7f64667fc640 1 -- 172.21.15.16:0/3862017420 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647001f7b0 con 0x559630c75cd0 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.187+0000 7f64667fc640 1 -- 172.21.15.16:0/3862017420 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64700233c0 con 0x559630c75cd0 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.187+0000 7f64667fc640 1 -- 172.21.15.16:0/3862017420 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647001e5f0 con 0x559630c75cd0 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- 172.21.15.16:0/3862017420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 msgr2=0x559631064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 0x559631064ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6470000c00 tx=0x7f6470005f90 comp rx=0 tx=0).stop 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- 172.21.15.16:0/3862017420 shutdown_connections 2024-09-21T00:47:10.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c96670 0x559631071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c8e490 0x559631071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 --2- 172.21.15.16:0/3862017420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c75cd0 0x559631064ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- 172.21.15.16:0/3862017420 >> 172.21.15.16:0/3862017420 conn(0x559630cab740 msgr2=0x559631064490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- 172.21.15.16:0/3862017420 shutdown_connections 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- 172.21.15.16:0/3862017420 wait complete. 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.188+0000 7f648907a740 1 -- start start 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 Processor -- start 2024-09-21T00:47:10.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c75cd0 0x559631076560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c072460 con 0x559630c75cd0 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f647c071d90 con 0x559630c96670 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f647c06f010 con 0x559630c8e490 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f648907a740 10 client.0 _ll_register_callbacks cb 0x7f64700097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f647bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.189+0000 7f647bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:58842/0 (socket says 172.21.15.16:58842) 2024-09-21T00:47:10.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 -- 172.21.15.16:0/3543933032 learned_addr learned my addr 172.21.15.16:0/3543933032 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:10.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f64808a2640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c75cd0 0x559631076560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f64810a3640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 -- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 msgr2=0x559631076fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631076fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 -- 172.21.15.16:0/3543933032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c75cd0 msgr2=0x559631076560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c75cd0 0x559631076560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 -- 172.21.15.16:0/3543933032 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963107eb60 con 0x559630c8e490 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f647bfff640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64680cd3e0 tx=0x7f6468004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5716089f72f4d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.190+0000 7f645bfff640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64680cce50 con 0x559630c8e490 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f64680c9030 con 0x559630c8e490 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64700233c0 con 0x559630c8e490 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64680d7100 con 0x559630c8e490 2024-09-21T00:47:10.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 10 client.25360 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55963107fe20 con 0x559630c8e490 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64680d21c0 con 0x559630c8e490 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64680cea10 con 0x559630c8e490 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 10 client.25360 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 10 client.25360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 20 client.25360 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.191+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630cb7350 0x559631082360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.192+0000 7f648907a740 4 client.25360 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.192+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f64700233c0 con 0x559630cb7350 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.192+0000 7f64808a2640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630cb7350 0x559631082360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.192+0000 7f645bfff640 10 client.25360 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:10.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.192+0000 7f64808a2640 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630cb7350 0x559631082360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b3ee6f5905fc7a8 server_cookie=a0e123e536754168 in_seq=0 out_seq=0 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.194+0000 7f645bfff640 1 -- 172.21.15.16:0/3543933032 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f64700233c0 con 0x559630cb7350 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f645bfff640 10 client.25360 handle_command_reply: tid=0 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 client.25360 shutdown 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 msgr2=0x559631076aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64680cd3e0 tx=0x7f6468004610 comp rx=0 tx=0).stop 2024-09-21T00:47:10.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 shutdown_connections 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559630cb7350 0x559631082360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f645bfff640 0 client.25360 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559630c96670 0x559631076fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559630c8e490 0x559631076aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 --2- 172.21.15.16:0/3543933032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559630c75cd0 0x559631076560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "d3245a0c-cad6-40bc-9fe5-0818d28432a1", 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-21T00:47:10.199 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 >> 172.21.15.16:0/3543933032 conn(0x559630cab740 msgr2=0x55963105a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 shutdown_connections 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 1 -- 172.21.15.16:0/3543933032 wait complete. 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.195+0000 7f648907a740 20 client.25360 trim_cache size 0 max 16384 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.196+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 msgr2=0x7f646c0b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.196+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 0x7f646c0b8bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6474005fd0 tx=0x7f6474009540 comp rx=0 tx=0).stop 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.196+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 msgr2=0x7f647c19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.196+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6468009850 tx=0x7f64680305d0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 shutdown_connections 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f646c0b66e0 0x7f646c0b8bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f647c104660 0x7f647c1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c102890 0x7f647c19ca10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 --2- 172.21.15.16:0/3340388811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f647c101d70 0x7f647c19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 >> 172.21.15.16:0/3340388811 conn(0x7f647c077c60 msgr2=0x7f647c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 shutdown_connections 2024-09-21T00:47:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:10.197+0000 7f6482b06640 1 -- 172.21.15.16:0/3340388811 wait complete. 2024-09-21T00:47:10.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:09 smithi123 ceph-mon[34853]: pgmap v376: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:10.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:09 smithi178 ceph-mon[34888]: pgmap v376: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:11.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:47:11.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:10 smithi016 ceph-mon[30947]: scrub queued for path: / 2024-09-21T00:47:11.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:10 smithi016 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:10 smithi016 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-21T00:47:11.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:10 smithi016 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:10 smithi123 ceph-mon[34853]: scrub queued for path: / 2024-09-21T00:47:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:10 smithi123 ceph-mon[34853]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:10 smithi123 ceph-mon[34853]: scrub summary: active paths [/] 2024-09-21T00:47:11.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:10 smithi123 ceph-mon[34853]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:10 smithi178 ceph-mon[34888]: scrub queued for path: / 2024-09-21T00:47:11.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:10 smithi178 ceph-mon[34888]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:10 smithi178 ceph-mon[34888]: scrub summary: active paths [/] 2024-09-21T00:47:11.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:10 smithi178 ceph-mon[34888]: scrub summary: idle+waiting paths [/] 2024-09-21T00:47:11.505 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 -- 172.21.15.16:0/1651444150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b601083a0 msgr2=0x7f4b601087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 --2- 172.21.15.16:0/1651444150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b601083a0 0x7f4b601087b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009900 tx=0x7f4b4802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 -- 172.21.15.16:0/1651444150 shutdown_connections 2024-09-21T00:47:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 --2- 172.21.15.16:0/1651444150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60108cf0 0x7f4b6010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 --2- 172.21.15.16:0/1651444150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b601083a0 0x7f4b601087b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 --2- 172.21.15.16:0/1651444150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b60102a60 0x7f4b60102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 -- 172.21.15.16:0/1651444150 >> 172.21.15.16:0/1651444150 conn(0x7f4b60079730 msgr2=0x7f4b60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 -- 172.21.15.16:0/1651444150 shutdown_connections 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.119+0000 7f4b665a5640 1 -- 172.21.15.16:0/1651444150 wait complete. 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.120+0000 7f4b665a5640 1 Processor -- start 2024-09-21T00:47:12.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.120+0000 7f4b665a5640 1 -- start start 2024-09-21T00:47:12.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 0x7f4b601a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 0x7f4b601a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112960 con 0x7f4b60108cf0 2024-09-21T00:47:12.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601127e0 con 0x7f4b601083a0 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b665a5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112ae0 con 0x7f4b60102a60 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b64b42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b64b42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45964/0 (socket says 172.21.15.16:45964) 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b64b42640 1 -- 172.21.15.16:0/3203615176 learned_addr learned my addr 172.21.15.16:0/3203615176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 0x7f4b601a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.121+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 0x7f4b601a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 -- 172.21.15.16:0/3203615176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 msgr2=0x7f4b601a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 0x7f4b601a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 -- 172.21.15.16:0/3203615176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 msgr2=0x7f4b601a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 0x7f4b601a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 -- 172.21.15.16:0/3203615176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b601a6a90 con 0x7f4b60108cf0 2024-09-21T00:47:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 0x7f4b601a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b64b42640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800efd0 tx=0x7f4b5800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 0x7f4b601a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b5dffb640 1 -- 172.21.15.16:0/3203615176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003b70 con 0x7f4b60108cf0 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b601a6d80 con 0x7f4b60108cf0 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601ad4e0 con 0x7f4b60108cf0 2024-09-21T00:47:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b5dffb640 1 -- 172.21.15.16:0/3203615176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b58003d10 con 0x7f4b60108cf0 2024-09-21T00:47:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.122+0000 7f4b5dffb640 1 -- 172.21.15.16:0/3203615176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58004d40 con 0x7f4b60108cf0 2024-09-21T00:47:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.126+0000 7f4b6cb19740 1 Processor -- start 2024-09-21T00:47:12.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b5dffb640 1 -- 172.21.15.16:0/3203615176 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4b58010730 con 0x7f4b60108cf0 2024-09-21T00:47:12.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 -- start start 2024-09-21T00:47:12.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcc20070 0x5598dcfc7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5598dcf3de50 con 0x5598dcbff390 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5598dcf2d280 con 0x5598dcbf71b0 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5598dcf31090 con 0x5598dcc20070 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45970/0 (socket says 172.21.15.16:45970) 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b57fff640 1 -- 172.21.15.16:0/3222664944 learned_addr learned my addr 172.21.15.16:0/3222664944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.127+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcc20070 0x5598dcfc7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 -- 172.21.15.16:0/3222664944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcc20070 msgr2=0x5598dcfc7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcc20070 0x5598dcfc7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 -- 172.21.15.16:0/3222664944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 msgr2=0x5598dcfc77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 -- 172.21.15.16:0/3222664944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dcc8b650 con 0x5598dcbff390 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.128+0000 7f4b57fff640 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4b6006aaa0 tx=0x7f4b48032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f41fb7d2cfba03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.129+0000 7f4b567fc640 1 -- 172.21.15.16:0/3222664944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48035040 con 0x5598dcbff390 2024-09-21T00:47:12.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.129+0000 7f4b567fc640 1 -- 172.21.15.16:0/3222664944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b48005500 con 0x5598dcbff390 2024-09-21T00:47:12.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.129+0000 7f4b5dffb640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 0x7f4b4c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.129+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 0x7f4b4c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b5dffb640 1 -- 172.21.15.16:0/3203615176 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f4b580e7690 con 0x7f4b60108cf0 2024-09-21T00:47:12.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b567fc640 1 -- 172.21.15.16:0/3222664944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48004c70 con 0x5598dcbff390 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 -- 172.21.15.16:0/3222664944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 msgr2=0x5598dcfc7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4b6006aaa0 tx=0x7f4b48032ed0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 -- 172.21.15.16:0/3222664944 shutdown_connections 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfc7cf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/3222664944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcc20070 0x5598dcfc7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 0x7f4b4c0b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5598dcfc5ef0 tx=0x7f4b500094a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 -- 172.21.15.16:0/3222664944 >> 172.21.15.16:0/3222664944 conn(0x5598dcc14460 msgr2=0x5598dcfc5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.130+0000 7f4b6cb19740 1 -- 172.21.15.16:0/3222664944 shutdown_connections 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.131+0000 7f4b6cb19740 1 -- 172.21.15.16:0/3222664944 wait complete. 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.131+0000 7f4b6cb19740 1 -- start start 2024-09-21T00:47:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.132+0000 7f4b6cb19740 1 Processor -- start 2024-09-21T00:47:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.132+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 0x5598dcfd28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.132+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 0x5598dcfd3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b5ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 0x5598dcfd28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45978/0 (socket says 172.21.15.16:45978) 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b57fff640 1 -- 172.21.15.16:0/56049690 learned_addr learned my addr 172.21.15.16:0/56049690 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5598dcd8e700 con 0x5598dcbff390 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b64b42640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 0x5598dcfd3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5598dcec8110 con 0x5598dcc20070 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5598dcfd5a90 con 0x5598dcbf71b0 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.133+0000 7f4b6cb19740 10 client.0 _ll_register_callbacks cb 0x5598dcee1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 -- 172.21.15.16:0/56049690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 msgr2=0x5598dcfd28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 0x5598dcfd28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 -- 172.21.15.16:0/56049690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 msgr2=0x5598dcfd2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598dcef5c40 con 0x5598dcc20070 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b64b42640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 0x5598dcfd3360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b580e5270 tx=0x7f4b58004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3535105f88e42de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580b2030 con 0x5598dcc20070 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b57fff640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 0x5598dcfd28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f4b580a9400 con 0x5598dcc20070 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.134+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b48005500 con 0x5598dcc20070 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.135+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b580ad200 con 0x5598dcc20070 2024-09-21T00:47:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.135+0000 7f4b6cb19740 10 client.25346 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.135+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598dcfe1740 con 0x5598dcc20070 2024-09-21T00:47:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.135+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b5806be50 con 0x5598dcc20070 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4b5801f020 con 0x5598dcc20070 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 10 client.25346 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 10 client.25346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 20 client.25346 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcbde9f0 0x5598dcfe4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 4 client.25346 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:12.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598dcf3fda0 con 0x5598dcbde9f0 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.136+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcbde9f0 0x5598dcfe4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.137+0000 7f4b3f7fe640 10 client.25346 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.137+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcbde9f0 0x5598dcfe4c10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2705b5dfb3b89c6e server_cookie=a816b28c33effa13 in_seq=0 out_seq=0 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.138+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/56049690 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598dcf3fda0 con 0x5598dcbde9f0 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.138+0000 7f4b3f7fe640 10 client.25346 handle_command_reply: tid=0 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.138+0000 7f4b6cb19740 1 client.25346 shutdown 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 msgr2=0x5598dcfd3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 0x5598dcfd3360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b580e5270 tx=0x7f4b58004820 comp rx=0 tx=0).stop 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 shutdown_connections 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcbde9f0 0x5598dcfe4c10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcc20070 0x5598dcfd3360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b3f7fe640 0 client.25346 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfd2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/56049690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbf71b0 0x5598dcfd28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.139+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 >> 172.21.15.16:0/56049690 conn(0x5598dcc14460 msgr2=0x5598dcfca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.140+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 shutdown_connections 2024-09-21T00:47:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.140+0000 7f4b6cb19740 1 -- 172.21.15.16:0/56049690 wait complete. 2024-09-21T00:47:12.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.140+0000 7f4b6cb19740 20 client.25346 trim_cache size 0 max 16384 2024-09-21T00:47:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.175+0000 7f4b6cb19740 1 Processor -- start 2024-09-21T00:47:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.175+0000 7f4b6cb19740 1 -- start start 2024-09-21T00:47:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbde9f0 0x5598dcfd4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b5960 con 0x5598dcbff390 2024-09-21T00:47:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b74a0 con 0x5598dcbf71b0 2024-09-21T00:47:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b6cb19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b6030 con 0x5598dcbde9f0 2024-09-21T00:47:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b64b42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b64b42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45992/0 (socket says 172.21.15.16:45992) 2024-09-21T00:47:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b64b42640 1 -- 172.21.15.16:0/1154808902 learned_addr learned my addr 172.21.15.16:0/1154808902 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.176+0000 7f4b57fff640 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbde9f0 0x5598dcfd4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 -- 172.21.15.16:0/1154808902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbde9f0 msgr2=0x5598dcfd4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbde9f0 0x5598dcfd4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 -- 172.21.15.16:0/1154808902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 msgr2=0x5598dcfc89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 -- 172.21.15.16:0/1154808902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dcfd3b60 con 0x5598dcbff390 2024-09-21T00:47:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.177+0000 7f4b64b42640 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b580ad840 tx=0x7f4b580b73e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f199a7ecf75c9b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.178+0000 7f4b55ffb640 1 -- 172.21.15.16:0/1154808902 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580b2040 con 0x5598dcbff390 2024-09-21T00:47:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.178+0000 7f4b55ffb640 1 -- 172.21.15.16:0/1154808902 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b48005500 con 0x5598dcbff390 2024-09-21T00:47:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.178+0000 7f4b55ffb640 1 -- 172.21.15.16:0/1154808902 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580ad020 con 0x5598dcbff390 2024-09-21T00:47:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 -- 172.21.15.16:0/1154808902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 msgr2=0x5598dcfcfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b580ad840 tx=0x7f4b580b73e0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 -- 172.21.15.16:0/1154808902 shutdown_connections 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbff390 0x5598dcfcfa90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbf71b0 0x5598dcfc89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/1154808902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbde9f0 0x5598dcfd4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 -- 172.21.15.16:0/1154808902 >> 172.21.15.16:0/1154808902 conn(0x5598dcc14460 msgr2=0x5598dcfc82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 -- 172.21.15.16:0/1154808902 shutdown_connections 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.179+0000 7f4b6cb19740 1 -- 172.21.15.16:0/1154808902 wait complete. 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.180+0000 7f4b6cb19740 1 -- start start 2024-09-21T00:47:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.180+0000 7f4b6cb19740 1 Processor -- start 2024-09-21T00:47:12.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:11 smithi016 ceph-mon[30947]: pgmap v377: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbf71b0 0x5598dcfd7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbff390 0x5598dd048490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:42958/0 (socket says 172.21.15.16:42958) 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 -- 172.21.15.16:0/2582535034 learned_addr learned my addr 172.21.15.16:0/2582535034 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b6dd0 con 0x5598dcbf71b0 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b6700 con 0x5598dcbde9f0 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b57fff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbf71b0 0x5598dcfd7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b3940 con 0x5598dcbff390 2024-09-21T00:47:12.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b6cb19740 10 client.0 _ll_register_callbacks cb 0x7f4b580048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b64b42640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbff390 0x5598dd048490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 -- 172.21.15.16:0/2582535034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbff390 msgr2=0x5598dd048490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbff390 0x5598dd048490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 -- 172.21.15.16:0/2582535034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbf71b0 msgr2=0x5598dcfd7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbf71b0 0x5598dcfd7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.181+0000 7f4b5ffff640 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598dd048b00 con 0x5598dcbde9f0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b5ffff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b500125a0 tx=0x7f4b500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3259b1d074278ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50005230 con 0x5598dcbde9f0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mon.2 v2:172.21.15.123:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f4b500053d0 con 0x5598dcbde9f0 2024-09-21T00:47:12.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b48005500 con 0x5598dcbde9f0 2024-09-21T00:47:12.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b500055d0 con 0x5598dcbde9f0 2024-09-21T00:47:12.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b6cb19740 10 client.25352 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:12.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.182+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598dd04fea0 con 0x5598dcbde9f0 2024-09-21T00:47:12.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mon.2 v2:172.21.15.123:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b48005500 con 0x5598dcbde9f0 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mon.2 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4b5000f040 con 0x5598dcbde9f0 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 10 client.25352 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 20 client.25352 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcc20070 0x5598dd0526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 4 client.25352 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5598dcf3b850 con 0x5598dcc20070 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.183+0000 7f4b57fff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcc20070 0x5598dd0526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.184+0000 7f4b3f7fe640 10 client.25352 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:12.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.184+0000 7f4b57fff640 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcc20070 0x5598dd0526e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda009be1542d0cd server_cookie=5c48f5a602cc593e in_seq=0 out_seq=0 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b3f7fe640 1 -- 172.21.15.16:0/2582535034 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x5598dcf3b850 con 0x5598dcc20070 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b3f7fe640 10 client.25352 handle_command_reply: tid=0 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b6cb19740 1 client.25352 shutdown 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 msgr2=0x5598dcfd7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b500125a0 tx=0x7f4b500046c0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 shutdown_connections 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.185+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5598dcc20070 0x5598dd0526e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b3f7fe640 0 client.25352 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598dcbff390 0x5598dd048490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5598dcbf71b0 0x5598dcfd7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 --2- 172.21.15.16:0/2582535034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5598dcbde9f0 0x5598dcfd7610 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b500125a0 tx=0x7f4b500046c0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 >> 172.21.15.16:0/2582535034 conn(0x5598dcc14460 msgr2=0x5598dcfc82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 shutdown_connections 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 1 -- 172.21.15.16:0/2582535034 wait complete. 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.186+0000 7f4b6cb19740 20 client.25352 trim_cache size 0 max 16384 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:47:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "d3245a0c-cad6-40bc-9fe5-0818d28432a1": { 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "d3245a0c-cad6-40bc-9fe5-0818d28432a1", 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "d3245a0c-cad6-40bc-9fe5-0818d28432a1": { 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:47:10.192603+0000", 2024-09-21T00:47:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "b48866e0-3f81-43b8-b9d9-9af98dd7a373": { 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:46:23.778707+0000", 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:12.192 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.187+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 msgr2=0x7f4b4c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.187+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 0x7f4b4c0b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5598dcfc5ef0 tx=0x7f4b500094a0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.187+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 msgr2=0x7f4b601a6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.187+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800efd0 tx=0x7f4b5800c6a0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.187+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 shutdown_connections 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f4b4c0b6510 0x7f4b4c0b8a20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60108cf0 0x7f4b601a6360 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b601083a0 0x7f4b601a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 --2- 172.21.15.16:0/3203615176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b60102a60 0x7f4b601a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 >> 172.21.15.16:0/3203615176 conn(0x7f4b60079730 msgr2=0x7f4b6006b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:12.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 shutdown_connections 2024-09-21T00:47:12.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:12.188+0000 7f4b665a5640 1 -- 172.21.15.16:0/3203615176 wait complete. 2024-09-21T00:47:12.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:11 smithi123 ceph-mon[34853]: pgmap v377: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T00:47:12.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:11 smithi178 ceph-mon[34888]: pgmap v377: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T00:47:12.914 INFO:tasks.cephfs.filesystem:scrub status for tag:d3245a0c-cad6-40bc-9fe5-0818d28432a1 - {'path': '/', 'tag': 'd3245a0c-cad6-40bc-9fe5-0818d28432a1', 'options': 'recursive,force'} 2024-09-21T00:47:12.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:12 smithi016 ceph-mon[30947]: scrub summary: idle 2024-09-21T00:47:13.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:12 smithi123 ceph-mon[34853]: scrub summary: idle 2024-09-21T00:47:13.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:12 smithi178 ceph-mon[34888]: scrub summary: idle 2024-09-21T00:47:14.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:13 smithi016 ceph-mon[30947]: pgmap v378: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:14.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:13 smithi123 ceph-mon[34853]: pgmap v378: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:14.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:13 smithi178 ceph-mon[34888]: pgmap v378: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-09-21T00:47:15.677 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 -- 172.21.15.16:0/2458710003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 msgr2=0x7f130c106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 --2- 172.21.15.16:0/2458710003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c106380 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1300009900 tx=0x7f130002a410 comp rx=0 tx=0).stop 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 -- 172.21.15.16:0/2458710003 shutdown_connections 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 --2- 172.21.15.16:0/2458710003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 0x7f130c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 --2- 172.21.15.16:0/2458710003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 0x7f130c108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 --2- 172.21.15.16:0/2458710003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c106380 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 -- 172.21.15.16:0/2458710003 >> 172.21.15.16:0/2458710003 conn(0x7f130c0fdee0 msgr2=0x7f130c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 -- 172.21.15.16:0/2458710003 shutdown_connections 2024-09-21T00:47:15.678 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.676+0000 7f1312f62640 1 -- 172.21.15.16:0/2458710003 wait complete. 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.677+0000 7f1312f62640 1 Processor -- start 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.677+0000 7f1312f62640 1 -- start start 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 0x7f130c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 0x7f130c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.681 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59080/0 (socket says 172.21.15.16:59080) 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 -- 172.21.15.16:0/1642626025 learned_addr learned my addr 172.21.15.16:0/1642626025 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f130c10f2d0 con 0x7f130c06b670 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f130c10f150 con 0x7f130c1068c0 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f130c10f450 con 0x7f130c1093d0 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f130bfff640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 0x7f130c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f13114ff640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 0x7f130c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 -- 172.21.15.16:0/1642626025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 msgr2=0x7f130c19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 0x7f130c19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 -- 172.21.15.16:0/1642626025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 msgr2=0x7f130c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 0x7f130c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.678+0000 7f1310cfe640 1 -- 172.21.15.16:0/1642626025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c19b990 con 0x7f130c06b670 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1310cfe640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1300006010 tx=0x7f13000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1309ffb640 1 -- 172.21.15.16:0/1642626025 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130003f030 con 0x7f130c06b670 2024-09-21T00:47:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1309ffb640 1 -- 172.21.15.16:0/1642626025 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1300031910 con 0x7f130c06b670 2024-09-21T00:47:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c19bc20 con 0x7f130c06b670 2024-09-21T00:47:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1309ffb640 1 -- 172.21.15.16:0/1642626025 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300035070 con 0x7f130c06b670 2024-09-21T00:47:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.679+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c1a2190 con 0x7f130c06b670 2024-09-21T00:47:15.684 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 Processor -- start 2024-09-21T00:47:15.684 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 -- start start 2024-09-21T00:47:15.684 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 0x5592000c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5592000386f0 con 0x5591ffcfd4d0 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559200027b20 con 0x5591ffd1e1b0 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.682+0000 7f1319ed2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55920002b930 con 0x5591ffcf52f0 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59086/0 (socket says 172.21.15.16:59086) 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f130bfff640 1 -- 172.21.15.16:0/3092845878 learned_addr learned my addr 172.21.15.16:0/3092845878 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 0x5592000c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f1309ffb640 1 -- 172.21.15.16:0/1642626025 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1300042030 con 0x7f130c06b670 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 -- 172.21.15.16:0/3092845878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 msgr2=0x5592000c64c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000c64c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 -- 172.21.15.16:0/3092845878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 msgr2=0x5592000c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 -- 172.21.15.16:0/3092845878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591fffed530 con 0x5591ffd1e1b0 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.683+0000 7f13114ff640 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 0x5592000c5e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e60 tx=0x7f13040117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35fc66914372d53c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.684+0000 7f12f6ffd640 1 -- 172.21.15.16:0/3092845878 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304012650 con 0x5591ffd1e1b0 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.684+0000 7f12f6ffd640 1 -- 172.21.15.16:0/3092845878 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1304012ca0 con 0x5591ffd1e1b0 2024-09-21T00:47:15.686 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.684+0000 7f12f6ffd640 1 -- 172.21.15.16:0/3092845878 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130400fdd0 con 0x5591ffd1e1b0 2024-09-21T00:47:15.687 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1309ffb640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 0x7f12fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.687 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 -- 172.21.15.16:0/3092845878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 msgr2=0x5592000c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.687 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1309ffb640 1 -- 172.21.15.16:0/1642626025 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f1300107810 con 0x7f130c06b670 2024-09-21T00:47:15.687 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 0x5592000c5e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e60 tx=0x7f13040117b0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1310cfe640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 0x7f12fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 -- 172.21.15.16:0/3092845878 shutdown_connections 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 --2- 172.21.15.16:0/3092845878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffd1e1b0 0x5592000c5e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.685+0000 7f1319ed2740 1 -- 172.21.15.16:0/3092845878 >> 172.21.15.16:0/3092845878 conn(0x5591ffd12300 msgr2=0x5592000c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.686+0000 7f1310cfe640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 0x7f12fc0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f13000ca000 tx=0x7f130003b5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.686+0000 7f1319ed2740 1 -- 172.21.15.16:0/3092845878 shutdown_connections 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.686+0000 7f1319ed2740 1 -- 172.21.15.16:0/3092845878 wait complete. 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.686+0000 7f1319ed2740 1 -- start start 2024-09-21T00:47:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.686+0000 7f1319ed2740 1 Processor -- start 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 0x5592000d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59088/0 (socket says 172.21.15.16:59088) 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f130bfff640 1 -- 172.21.15.16:0/2076770317 learned_addr learned my addr 172.21.15.16:0/2076770317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5591fff5fab0 con 0x5591ffcfd4d0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5591fffcd730 con 0x5591ffcf52f0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f13114ff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 0x5592000d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.687+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5592000c7b30 con 0x5591ffd1e1b0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f1319ed2740 10 client.0 _ll_register_callbacks cb 0x5592000216b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f13114ff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 -- 172.21.15.16:0/2076770317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 msgr2=0x5592000d9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000d9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 -- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 msgr2=0x5592000d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 0x5592000d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ffd89790 con 0x5591ffcfd4d0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f13114ff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 0x5592000d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f130bfff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f12f8012740 tx=0x7f12f8012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb15d152de96566 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f12ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f12ebfff640 1 -- 172.21.15.16:0/2076770317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8004050 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.688+0000 7f12ebfff640 1 -- 172.21.15.16:0/2076770317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f12f80041f0 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.689+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1304012ca0 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.689+0000 7f12ebfff640 1 -- 172.21.15.16:0/2076770317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12f80043f0 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.689+0000 7f1319ed2740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.689+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5591ffe02620 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f12ebfff640 1 -- 172.21.15.16:0/2076770317 <== mon.0 v2:172.21.15.16:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f12f800f920 con 0x5591ffcfd4d0 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 20 client.15702 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5591ffcdcd80 0x5592000e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 4 client.15702 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1304012ca0 con 0x5591ffcdcd80 2024-09-21T00:47:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.690+0000 7f13114ff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5591ffcdcd80 0x5592000e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.691+0000 7f12ebfff640 10 client.15702 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.691+0000 7f13114ff640 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5591ffcdcd80 0x5592000e5350 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c9fdfe295cff12 server_cookie=5fb84091744e8757 in_seq=0 out_seq=0 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.691+0000 7f12ebfff640 1 -- 172.21.15.16:0/2076770317 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1304012ca0 con 0x5591ffcdcd80 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.691+0000 7f12ebfff640 10 client.15702 handle_command_reply: tid=0 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 client.15702 shutdown 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 msgr2=0x5592000d84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f12f8012740 tx=0x7f12f8012c00 comp rx=0 tx=0).stop 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 shutdown_connections 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5591ffcdcd80 0x5592000e5350 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000d9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcfd4d0 0x5592000d84e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2076770317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcf52f0 0x5592000d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 >> 172.21.15.16:0/2076770317 conn(0x5591ffd12300 msgr2=0x5592000bfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f12ebfff640 0 client.15702 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 shutdown_connections 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 1 -- 172.21.15.16:0/2076770317 wait complete. 2024-09-21T00:47:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.692+0000 7f1319ed2740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T00:47:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 Processor -- start 2024-09-21T00:47:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 -- start start 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000e5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a8b80 con 0x5591ffd1e1b0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.721+0000 7f1319ed2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1aa6c0 con 0x5591ffcb21c0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f1319ed2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a9250 con 0x5591ffcf52f0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59098/0 (socket says 172.21.15.16:59098) 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 -- 172.21.15.16:0/2604101031 learned_addr learned my addr 172.21.15.16:0/2604101031 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f13114ff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f13114ff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 -- 172.21.15.16:0/2604101031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 msgr2=0x5592000e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 -- 172.21.15.16:0/2604101031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 msgr2=0x5592000bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 -- 172.21.15.16:0/2604101031 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592000c3340 con 0x5591ffd1e1b0 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f13114ff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.722+0000 7f130bfff640 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f12f80045b0 tx=0x7f12f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d96d261db4ba8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.723+0000 7f12f67fc640 1 -- 172.21.15.16:0/2604101031 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f800fe20 con 0x5591ffd1e1b0 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.723+0000 7f12f67fc640 1 -- 172.21.15.16:0/2604101031 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f8012e50 con 0x5591ffd1e1b0 2024-09-21T00:47:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.723+0000 7f12f67fc640 1 -- 172.21.15.16:0/2604101031 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8027e30 con 0x5591ffd1e1b0 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- 172.21.15.16:0/2604101031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 msgr2=0x5592000c1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f12f80045b0 tx=0x7f12f8013000 comp rx=0 tx=0).stop 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- 172.21.15.16:0/2604101031 shutdown_connections 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffd1e1b0 0x5592000c1220 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2604101031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffcf52f0 0x5592000e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- 172.21.15.16:0/2604101031 >> 172.21.15.16:0/2604101031 conn(0x5591ffd12300 msgr2=0x5592000c6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- 172.21.15.16:0/2604101031 shutdown_connections 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- 172.21.15.16:0/2604101031 wait complete. 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.724+0000 7f1319ed2740 1 -- start start 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.725+0000 7f1319ed2740 1 Processor -- start 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.725+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.725+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 0x5592000dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.725+0000 7f1319ed2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f1319ed2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a9ff0 con 0x5591ffcf52f0 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f1319ed2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a9920 con 0x5591ffcb21c0 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f13114ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f1319ed2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a6b60 con 0x5591ffd1e1b0 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 0x5592000dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f13114ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:42522/0 (socket says 172.21.15.16:42522) 2024-09-21T00:47:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f13114ff640 1 -- 172.21.15.16:0/2701170059 learned_addr learned my addr 172.21.15.16:0/2701170059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f1319ed2740 10 client.0 _ll_register_callbacks cb 0x7f12f8009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f13114ff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 -- 172.21.15.16:0/2701170059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 msgr2=0x5592000ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 -- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 msgr2=0x5592000dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 -- 172.21.15.16:0/2701170059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592000de6f0 con 0x5591ffcf52f0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f13114ff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f130bfff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 0x5592000dd490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12f80058c0 tx=0x7f12f800fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbcfc44e1baaa57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f12ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.726+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8035020 con 0x5591ffcf52f0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f12f8027dc0 con 0x5591ffcf52f0 2024-09-21T00:47:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12f8012e50 con 0x5591ffcf52f0 2024-09-21T00:47:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12f800fe20 con 0x5591ffcf52f0 2024-09-21T00:47:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f1319ed2740 10 client.15708 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592000df9c0 con 0x5591ffcf52f0 2024-09-21T00:47:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.727+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12f8012e50 con 0x5591ffcf52f0 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.728+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f12f8031bb0 con 0x5591ffcf52f0 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.728+0000 7f1319ed2740 10 client.15708 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.728+0000 7f1319ed2740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.729+0000 7f1319ed2740 20 client.15708 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.729+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559200150120 0x559200152540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.729+0000 7f1319ed2740 4 client.15708 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.729+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55920003a640 con 0x559200150120 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.729+0000 7f13114ff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559200150120 0x559200152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.730+0000 7f13114ff640 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559200150120 0x559200152540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b5966e327809328 server_cookie=b055e21f6b8c3dac in_seq=0 out_seq=0 2024-09-21T00:47:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.730+0000 7f12ebfff640 10 client.15708 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f12ebfff640 1 -- 172.21.15.16:0/2701170059 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55920003a640 con 0x559200150120 2024-09-21T00:47:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f12ebfff640 10 client.15708 handle_command_reply: tid=0 2024-09-21T00:47:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 client.15708 shutdown 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 msgr2=0x5592000dd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 0x5592000dd490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f12f80058c0 tx=0x7f12f800fac0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 shutdown_connections 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x559200150120 0x559200152540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591ffd1e1b0 0x5592000ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5591ffcf52f0 0x5592000dd490 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 --2- 172.21.15.16:0/2701170059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591ffcb21c0 0x5592000dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 >> 172.21.15.16:0/2701170059 conn(0x5591ffd12300 msgr2=0x5592000c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.735+0000 7f12ebfff640 0 client.15708 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 shutdown_connections 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1319ed2740 1 -- 172.21.15.16:0/2701170059 wait complete. 2024-09-21T00:47:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1319ed2740 20 client.15708 trim_cache size 0 max 16384 2024-09-21T00:47:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:47:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:47:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:47:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 msgr2=0x7f12fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 0x7f12fc0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f13000ca000 tx=0x7f130003b5d0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.736+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 msgr2=0x7f130c199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1300006010 tx=0x7f13000042f0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 shutdown_connections 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f12fc0b6510 0x7f12fc0b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130c1093d0 0x7f130c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f130c1068c0 0x7f130c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 --2- 172.21.15.16:0/1642626025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f130c06b670 0x7f130c199f50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 >> 172.21.15.16:0/1642626025 conn(0x7f130c0fdee0 msgr2=0x7f130c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 shutdown_connections 2024-09-21T00:47:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:15.737+0000 7f1312f62640 1 -- 172.21.15.16:0/1642626025 wait complete. 2024-09-21T00:47:16.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:15 smithi016 ceph-mon[30947]: pgmap v379: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:47:16.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:15 smithi123 ceph-mon[34853]: pgmap v379: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:47:16.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:15 smithi178 ceph-mon[34888]: pgmap v379: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T00:47:18.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:17 smithi016 ceph-mon[30947]: pgmap v380: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:47:18.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:17 smithi123 ceph-mon[34853]: pgmap v380: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:47:18.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:17 smithi178 ceph-mon[34888]: pgmap v380: 97 pgs: 97 active+clean; 677 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:47:20.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:19 smithi016 ceph-mon[30947]: pgmap v381: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T00:47:20.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:19 smithi123 ceph-mon[34853]: pgmap v381: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T00:47:20.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:19 smithi178 ceph-mon[34888]: pgmap v381: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T00:47:22.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:21 smithi016 ceph-mon[30947]: pgmap v382: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:22.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:21 smithi123 ceph-mon[34853]: pgmap v382: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:22.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:21 smithi178 ceph-mon[34888]: pgmap v382: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:24.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:23 smithi016 ceph-mon[30947]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T00:47:24.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:23 smithi123 ceph-mon[34853]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T00:47:24.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:23 smithi178 ceph-mon[34888]: pgmap v383: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T00:47:26.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:25 smithi016 ceph-mon[30947]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:47:26.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:25 smithi123 ceph-mon[34853]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:47:26.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:25 smithi178 ceph-mon[34888]: pgmap v384: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T00:47:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:27 smithi016 ceph-mon[30947]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:28.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:27 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:27 smithi123 ceph-mon[34853]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:28.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:27 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:28.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:27 smithi178 ceph-mon[34888]: pgmap v385: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T00:47:28.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:27 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:47:28.427 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 89% (11349/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- 172.21.15.16:0/4253137628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103fc0 msgr2=0x7fc6f010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/4253137628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103fc0 0x7fc6f010a960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009c90 tx=0x7fc6e802a860 comp rx=0 tx=0).stop 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- 172.21.15.16:0/4253137628 shutdown_connections 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/4253137628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103fc0 0x7fc6f010a960 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/4253137628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f0103620 0x7fc6f0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/4253137628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f01025a0 0x7fc6f0102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- 172.21.15.16:0/4253137628 >> 172.21.15.16:0/4253137628 conn(0x7fc6f00fdee0 msgr2=0x7fc6f0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- 172.21.15.16:0/4253137628 shutdown_connections 2024-09-21T00:47:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- 172.21.15.16:0/4253137628 wait complete. 2024-09-21T00:47:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 Processor -- start 2024-09-21T00:47:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.837+0000 7fc6f64b2640 1 -- start start 2024-09-21T00:47:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f01025a0 0x7fc6f0199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 0x7fc6f019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010e220 con 0x7fc6f0103620 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010e0a0 con 0x7fc6f0103fc0 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010e3a0 con 0x7fc6f01025a0 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33268/0 (socket says 172.21.15.16:33268) 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 -- 172.21.15.16:0/21688319 learned_addr learned my addr 172.21.15.16:0/21688319 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6effff640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f01025a0 0x7fc6f0199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 0x7fc6f019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 -- 172.21.15.16:0/21688319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f01025a0 msgr2=0x7fc6f0199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f01025a0 0x7fc6f0199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 -- 172.21.15.16:0/21688319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 msgr2=0x7fc6f019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 0x7fc6f019b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 -- 172.21.15.16:0/21688319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f019b970 con 0x7fc6f0103620 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 0x7fc6f019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800e9f0 tx=0x7fc6d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6edffb640 1 -- 172.21.15.16:0/21688319 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800cd80 con 0x7fc6f0103620 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6edffb640 1 -- 172.21.15.16:0/21688319 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d80108e0 con 0x7fc6f0103620 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.838+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f019bc60 con 0x7fc6f0103620 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.839+0000 7fc6edffb640 1 -- 172.21.15.16:0/21688319 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8018980 con 0x7fc6f0103620 2024-09-21T00:47:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.839+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01a2350 con 0x7fc6f0103620 2024-09-21T00:47:28.847 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.841+0000 7fc6fd41d740 1 Processor -- start 2024-09-21T00:47:28.847 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.841+0000 7fc6edffb640 1 -- 172.21.15.16:0/21688319 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc6d8010430 con 0x7fc6f0103620 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.841+0000 7fc6fd41d740 1 -- start start 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9cff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 0x560af9d00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560af9c6d6f0 con 0x560af992a2f0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560af9c5cb20 con 0x560af99324d0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560af9c60930 con 0x560af99531b0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33278/0 (socket says 172.21.15.16:33278) 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 -- 172.21.15.16:0/2765289485 learned_addr learned my addr 172.21.15.16:0/2765289485 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9cff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 0x560af9d00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.848 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 -- 172.21.15.16:0/2765289485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 msgr2=0x560af9cff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9cff260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 -- 172.21.15.16:0/2765289485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 msgr2=0x560af9d00420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 0x560af9d00420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 -- 172.21.15.16:0/2765289485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af9c22530 con 0x560af992a2f0 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 0x560af9d00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6effff640 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009cf0 tx=0x7fc6e0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aa15bbce4b8c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.849 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.842+0000 7fc6e67fc640 1 -- 172.21.15.16:0/2765289485 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004230 con 0x560af992a2f0 2024-09-21T00:47:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6e67fc640 1 -- 172.21.15.16:0/2765289485 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e00043d0 con 0x560af992a2f0 2024-09-21T00:47:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6e67fc640 1 -- 172.21.15.16:0/2765289485 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0019820 con 0x560af992a2f0 2024-09-21T00:47:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6edffb640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 0x7fc6dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.850 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 0x7fc6dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6edffb640 1 -- 172.21.15.16:0/21688319 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6d80e7630 con 0x7fc6f0103620 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2765289485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 msgr2=0x560af9cff8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 0x7fc6dc0b8a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8031040 tx=0x7fc6e8031980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.843+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009cf0 tx=0x7fc6e0011810 comp rx=0 tx=0).stop 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2765289485 shutdown_connections 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99324d0 0x560af9d00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af992a2f0 0x560af9cff8d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2765289485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9cff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2765289485 >> 172.21.15.16:0/2765289485 conn(0x560af9947300 msgr2=0x560af9cf68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2765289485 shutdown_connections 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2765289485 wait complete. 2024-09-21T00:47:28.851 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- start start 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 Processor -- start 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9d08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9d09bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560af9b94ab0 con 0x560af99324d0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x560af9c02730 con 0x560af992a2f0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560af9d00f40 con 0x560af99531b0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.844+0000 7fc6fd41d740 10 client.0 _ll_register_callbacks cb 0x560af9c566b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33284/0 (socket says 172.21.15.16:33284) 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 -- 172.21.15.16:0/1594142772 learned_addr learned my addr 172.21.15.16:0/1594142772 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9d09bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.852 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6effff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9d08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 -- 172.21.15.16:0/1594142772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 msgr2=0x560af9d09bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9d09bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 -- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 msgr2=0x560af9d08a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9d08a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 -- 172.21.15.16:0/1594142772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af99be790 con 0x560af99324d0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80a9e00 tx=0x7fc6d80acfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b9e7c17355bdde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80ad340 con 0x560af99324d0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6d80e7110 con 0x560af99324d0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.845+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6e00043d0 con 0x560af99324d0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6d80adf30 con 0x560af99324d0 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 10 client.15720 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:28.853 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560af9a37620 con 0x560af99324d0 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e00043d0 con 0x560af99324d0 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6d80ac500 con 0x560af99324d0 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 10 client.15720 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 20 client.15720 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af9911d80 0x560af9d16030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 4 client.15720 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560af9c6f640 con 0x560af9911d80 2024-09-21T00:47:28.854 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.846+0000 7fc6effff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af9911d80 0x560af9d16030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.847+0000 7fc6cf7fe640 10 client.15720 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:28.855 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.847+0000 7fc6effff640 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af9911d80 0x560af9d16030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16145f9c4ed1110a server_cookie=695a7c97c1eb3e9a in_seq=0 out_seq=0 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/1594142772 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560af9c6f640 con 0x560af9911d80 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6cf7fe640 10 client.15720 handle_command_reply: tid=0 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 client.15720 shutdown 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 msgr2=0x560af9d090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80a9e00 tx=0x7fc6d80acfa0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 shutdown_connections 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af9911d80 0x560af9d16030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99531b0 0x560af9d09bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.856 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d090d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/1594142772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9d08a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 >> 172.21.15.16:0/1594142772 conn(0x560af9947300 msgr2=0x560af9cf74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6cf7fe640 0 client.15720 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 shutdown_connections 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 1 -- 172.21.15.16:0/1594142772 wait complete. 2024-09-21T00:47:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.848+0000 7fc6fd41d740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 Processor -- start 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 -- start start 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9cf6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 0x560af9cf15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01a8cd0 con 0x560af99531b0 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01aa810 con 0x560af992a2f0 2024-09-21T00:47:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01a93a0 con 0x560af99324d0 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33286/0 (socket says 172.21.15.16:33286) 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 -- 172.21.15.16:0/2756228452 learned_addr learned my addr 172.21.15.16:0/2756228452 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 0x560af9cf15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6effff640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9cf6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 -- 172.21.15.16:0/2756228452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 msgr2=0x560af9cf15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 0x560af9cf15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 -- 172.21.15.16:0/2756228452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 msgr2=0x560af9cf6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.863+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9cf6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6f4a4f640 1 -- 172.21.15.16:0/2756228452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af9cffcc0 con 0x560af99531b0 2024-09-21T00:47:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 0x560af9cf15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009c60 tx=0x7fc6e803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4079bc1ceeac678 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6e5ffb640 1 -- 172.21.15.16:0/2756228452 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8031ea0 con 0x560af99531b0 2024-09-21T00:47:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6e5ffb640 1 -- 172.21.15.16:0/2756228452 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e8036040 con 0x560af99531b0 2024-09-21T00:47:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.864+0000 7fc6e5ffb640 1 -- 172.21.15.16:0/2756228452 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8005330 con 0x560af99531b0 2024-09-21T00:47:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2756228452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 msgr2=0x560af9d073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009c60 tx=0x7fc6e803f000 comp rx=0 tx=0).stop 2024-09-21T00:47:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2756228452 shutdown_connections 2024-09-21T00:47:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99531b0 0x560af9d073d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af99324d0 0x560af9cf15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2756228452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af992a2f0 0x560af9cf6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2756228452 >> 172.21.15.16:0/2756228452 conn(0x560af9947300 msgr2=0x560af9cf6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2756228452 shutdown_connections 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2756228452 wait complete. 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.865+0000 7fc6fd41d740 1 -- start start 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 Processor -- start 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af992a2f0 0x560af9d0dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99531b0 0x560af9d0ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01aa140 con 0x560af99324d0 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01a9a70 con 0x560af99531b0 2024-09-21T00:47:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01a6cd0 con 0x560af992a2f0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6fd41d740 10 client.0 _ll_register_callbacks cb 0x7fc6d8009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33300/0 (socket says 172.21.15.16:33300) 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 -- 172.21.15.16:0/2539394786 learned_addr learned my addr 172.21.15.16:0/2539394786 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6f4a4f640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99531b0 0x560af9d0ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6effff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af992a2f0 0x560af9d0dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 -- 172.21.15.16:0/2539394786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af992a2f0 msgr2=0x560af9d0dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af992a2f0 0x560af9d0dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 -- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99531b0 msgr2=0x560af9d0ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99531b0 0x560af9d0ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 -- 172.21.15.16:0/2539394786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af9d0f440 con 0x560af99324d0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6e7fff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80ad7c0 tx=0x7fc6d80e7380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae00be3c2d927104 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.866+0000 7fc6cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80b20c0 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6d80aeb60 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6e8036040 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6d80b2310 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560af9d107a0 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e8036040 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6d80b6820 con 0x560af99324d0 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 20 client.15726 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af98e71c0 0x560af9d82c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 4 client.15726 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:47:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.867+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560af9c6b0f0 con 0x560af98e71c0 2024-09-21T00:47:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.868+0000 7fc6effff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af98e71c0 0x560af9d82c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.868+0000 7fc6effff640 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af98e71c0 0x560af9d82c10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47da0841d74137bb server_cookie=3b1c219efb56d4e4 in_seq=0 out_seq=0 2024-09-21T00:47:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.868+0000 7fc6cf7fe640 10 client.15726 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.872+0000 7fc6cf7fe640 1 -- 172.21.15.16:0/2539394786 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560af9c6b0f0 con 0x560af98e71c0 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.872+0000 7fc6cf7fe640 10 client.15726 handle_command_reply: tid=0 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.872+0000 7fc6fd41d740 1 client.15726 shutdown 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 msgr2=0x560af9d0e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80ad7c0 tx=0x7fc6d80e7380 comp rx=0 tx=0).stop 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 shutdown_connections 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x560af98e71c0 0x560af9d82c10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560af99531b0 0x560af9d0ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560af99324d0 0x560af9d0e170 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6cf7fe640 0 client.15726 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 --2- 172.21.15.16:0/2539394786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560af992a2f0 0x560af9d0dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 >> 172.21.15.16:0/2539394786 conn(0x560af9947300 msgr2=0x560af9d073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 shutdown_connections 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 1 -- 172.21.15.16:0/2539394786 wait complete. 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6fd41d740 20 client.15726 trim_cache size 0 max 16384 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:47:28.876 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:47:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 msgr2=0x7fc6dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 0x7fc6dc0b8a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8031040 tx=0x7fc6e8031980 comp rx=0 tx=0).stop 2024-09-21T00:47:28.877 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 msgr2=0x7fc6f019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.873+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800e9f0 tx=0x7fc6d800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 shutdown_connections 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6dc0b6510 0x7fc6dc0b8a20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f0103fc0 0x7fc6f019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f0103620 0x7fc6f019a5a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 --2- 172.21.15.16:0/21688319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6f01025a0 0x7fc6f0199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 >> 172.21.15.16:0/21688319 conn(0x7fc6f00fdee0 msgr2=0x7fc6f00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 shutdown_connections 2024-09-21T00:47:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:28.874+0000 7fc6f64b2640 1 -- 172.21.15.16:0/21688319 wait complete. 2024-09-21T00:47:29.174 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.175 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-21T00:47:29.176 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.176 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T00:47:29.176 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-21T00:47:29.176 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:47:29.181 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T00:47:29.258 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T00:47:29.260 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:47:29.261 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T00:47:29.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:29.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: pgmap v386: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:47:29.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:47:29.994 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T00:47:30.085 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T00:47:30.127 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:47:30.128 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:47:30.129 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T00:47:30.168 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:47:30.172 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:47:30.172 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T00:47:30.229 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-21T00:47:30.230 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-21T00:47:30.230 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-21T00:47:30.290 INFO:tasks.workunit.client.0.smithi016.stdout:test large (16MB) dio write 2024-09-21T00:47:30.291 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'test large (16MB) dio write' 2024-09-21T00:47:30.291 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-21T00:47:30.364 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-09-21T00:47:30.364 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-09-21T00:47:30.365 INFO:tasks.workunit.client.0.smithi016.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0719076 s, 233 MB/s 2024-09-21T00:47:30.365 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK 2024-09-21T00:47:30.365 INFO:tasks.workunit.client.0.smithi016.stdout:OK 2024-09-21T00:47:30.366 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:47:30.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:47:30.443 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-21T00:47:30.443 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-21T00:47:31.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:31 smithi016 ceph-mon[30947]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:47:31.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:31 smithi123 ceph-mon[34853]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:47:31.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:31 smithi178 ceph-mon[34888]: pgmap v387: 97 pgs: 97 active+clean; 678 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T00:47:33.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:33 smithi016 ceph-mon[30947]: pgmap v388: 97 pgs: 97 active+clean; 694 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:47:33.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:33 smithi123 ceph-mon[34853]: pgmap v388: 97 pgs: 97 active+clean; 694 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:47:33.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:33 smithi178 ceph-mon[34888]: pgmap v388: 97 pgs: 97 active+clean; 694 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T00:47:35.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:35 smithi016 ceph-mon[30947]: pgmap v389: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 718 KiB/s wr, 830 op/s 2024-09-21T00:47:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:35 smithi123 ceph-mon[34853]: pgmap v389: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 718 KiB/s wr, 830 op/s 2024-09-21T00:47:35.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:35 smithi178 ceph-mon[34888]: pgmap v389: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 718 KiB/s wr, 830 op/s 2024-09-21T00:47:37.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:37 smithi016 ceph-mon[30947]: pgmap v390: 97 pgs: 97 active+clean; 17 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.4 MiB/s wr, 831 op/s 2024-09-21T00:47:37.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:37 smithi123 ceph-mon[34853]: pgmap v390: 97 pgs: 97 active+clean; 17 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.4 MiB/s wr, 831 op/s 2024-09-21T00:47:37.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:37 smithi178 ceph-mon[34888]: pgmap v390: 97 pgs: 97 active+clean; 17 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.4 MiB/s wr, 831 op/s 2024-09-21T00:47:39.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:39 smithi016 ceph-mon[30947]: pgmap v391: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:39.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:39 smithi123 ceph-mon[34853]: pgmap v391: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:39.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:39 smithi178 ceph-mon[34888]: pgmap v391: 97 pgs: 97 active+clean; 9.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:40.000 INFO:tasks.workunit.client.0.smithi016.stdout:.......... 2024-09-21T00:47:40.001 INFO:tasks.workunit.client.0.smithi016.stdout:do_o_direct_reads: SUCCESS 2024-09-21T00:47:40.004 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:47:40.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:47:40.041 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-21T00:47:40.041 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-21T00:47:40.103 INFO:tasks.workunit.client.0.smithi016.stdout:test read from hole 2024-09-21T00:47:40.103 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'test read from hole' 2024-09-21T00:47:40.103 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-21T00:47:40.105 INFO:tasks.workunit.client.0.smithi016.stderr:0+0 records in 2024-09-21T00:47:40.105 INFO:tasks.workunit.client.0.smithi016.stderr:0+0 records out 2024-09-21T00:47:40.105 INFO:tasks.workunit.client.0.smithi016.stderr:0 bytes copied, 3.4073e-05 s, 0.0 kB/s 2024-09-21T00:47:40.105 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-21T00:47:40.107 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records in 2024-09-21T00:47:40.107 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records out 2024-09-21T00:47:40.107 INFO:tasks.workunit.client.0.smithi016.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00118625 s, 863 kB/s 2024-09-21T00:47:40.107 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-21T00:47:40.108 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records in 2024-09-21T00:47:40.108 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records out 2024-09-21T00:47:40.108 INFO:tasks.workunit.client.0.smithi016.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.0451e-05 s, 25.3 MB/s 2024-09-21T00:47:40.108 INFO:tasks.workunit.client.0.smithi016.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-21T00:47:40.108 INFO:tasks.workunit.client.0.smithi016.stdout:other thing 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'other thing' 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 4.7824e-05 s, 10.5 MB/s 2024-09-21T00:47:40.109 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-21T00:47:40.117 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records in 2024-09-21T00:47:40.118 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records out 2024-09-21T00:47:40.118 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 0.00642221 s, 77.9 kB/s 2024-09-21T00:47:40.118 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-21T00:47:40.120 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records in 2024-09-21T00:47:40.120 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records out 2024-09-21T00:47:40.120 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 0.00198215 s, 252 kB/s 2024-09-21T00:47:40.121 INFO:tasks.workunit.client.0.smithi016.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-21T00:47:40.121 INFO:tasks.workunit.client.0.smithi016.stdout:OK 2024-09-21T00:47:40.122 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK 2024-09-21T00:47:40.122 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:47:40.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:47:40.204 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-21T00:47:40.204 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-21T00:47:40.273 INFO:tasks.workunit.client.0.smithi016.stdout:writing first 3 bytes of 10k file 2024-09-21T00:47:40.273 INFO:tasks.workunit.client.0.smithi016.stdout:reading O_DIRECT 2024-09-21T00:47:40.273 INFO:tasks.workunit.client.0.smithi016.stdout:got 10000 2024-09-21T00:47:40.273 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:47:40.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:47:40.348 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-21T00:47:40.349 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-21T00:47:41.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:41 smithi016 ceph-mon[30947]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:41.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:41 smithi123 ceph-mon[34853]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:41.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:41 smithi178 ceph-mon[34888]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.38k op/s 2024-09-21T00:47:41.830 INFO:tasks.workunit.client.0.smithi016.stdout:writing pattern 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T00:47:41.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:41.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:41.833 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:41.835 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:41.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:41.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:41.855 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:41.856 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:41.857 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:41.859 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:41.860 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:41.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:41.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:41.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:41.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:41.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:41.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:41.868 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:41.869 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:41.870 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:41.871 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:41.878 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:41.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:41.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-21T00:47:41.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T00:47:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:41.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:41.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:41.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:41.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:41.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:41.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:41.923 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:41.925 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:41.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:41.953 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T00:47:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:41.956 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:41.957 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:41.974 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:41.974 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:41.974 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:41.974 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:41.976 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:41.978 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:41.979 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 -- 172.21.15.16:0/4254023403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2574104750 msgr2=0x7f2574104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 --2- 172.21.15.16:0/4254023403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2574104750 0x7f2574104b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f255c009860 tx=0x7f255c02a340 comp rx=0 tx=0).stop 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 -- 172.21.15.16:0/4254023403 shutdown_connections 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 --2- 172.21.15.16:0/4254023403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741050f0 0x7f257410ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 --2- 172.21.15.16:0/4254023403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2574104750 0x7f2574104b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 --2- 172.21.15.16:0/4254023403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25741036d0 0x7f2574103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 -- 172.21.15.16:0/4254023403 >> 172.21.15.16:0/4254023403 conn(0x7f25740ff030 msgr2=0x7f25741014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:41.985 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 -- 172.21.15.16:0/4254023403 shutdown_connections 2024-09-21T00:47:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.984+0000 7f2578962640 1 -- 172.21.15.16:0/4254023403 wait complete. 2024-09-21T00:47:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 Processor -- start 2024-09-21T00:47:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 -- start start 2024-09-21T00:47:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2574104750 0x7f2574075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25741050f0 0x7f2574075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f257410f320 con 0x7f25741036d0 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f257410f1a0 con 0x7f2574104750 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2578962640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f257410f4a0 con 0x7f25741050f0 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34190/0 (socket says 172.21.15.16:34190) 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f257259c640 1 -- 172.21.15.16:0/3779119020 learned_addr learned my addr 172.21.15.16:0/3779119020 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f256bfff640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2574104750 0x7f2574075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.985+0000 7f2572d9d640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25741050f0 0x7f2574075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 -- 172.21.15.16:0/3779119020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25741050f0 msgr2=0x7f2574075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25741050f0 0x7f2574075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 -- 172.21.15.16:0/3779119020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2574104750 msgr2=0x7f2574075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2574104750 0x7f2574075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 -- 172.21.15.16:0/3779119020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2574076380 con 0x7f25741036d0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f257259c640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f256400d770 tx=0x7f256400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f256b7fe640 1 -- 172.21.15.16:0/3779119020 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564017070 con 0x7f25741036d0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25741a4020 con 0x7f25741036d0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25741a44e0 con 0x7f25741036d0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f256b7fe640 1 -- 172.21.15.16:0/3779119020 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25640054d0 con 0x7f25741036d0 2024-09-21T00:47:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.986+0000 7f256b7fe640 1 -- 172.21.15.16:0/3779119020 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564020060 con 0x7f25741036d0 2024-09-21T00:47:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.989+0000 7f256b7fe640 1 -- 172.21.15.16:0/3779119020 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2564004c00 con 0x7f25741036d0 2024-09-21T00:47:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.989+0000 7f257f8d0740 1 Processor -- start 2024-09-21T00:47:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 -- start start 2024-09-21T00:47:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9dd84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9d4a6f0 con 0x55b4a9a0f4d0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9d39b20 con 0x55b4a9a301b0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257f8d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9d3d930 con 0x55b4a9a072f0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f256bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f2572d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f256b7fe640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 0x7f25600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f256bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34204/0 (socket says 172.21.15.16:34204) 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f257259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9dd84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f2572d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:50282/0 (socket says 172.21.15.16:50282) 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.990+0000 7f256bfff640 1 -- 172.21.15.16:0/1906348917 learned_addr learned my addr 172.21.15.16:0/1906348917 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2572d9d640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 0x7f25600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 -- 172.21.15.16:0/1906348917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 msgr2=0x55b4a9dd84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256b7fe640 1 -- 172.21.15.16:0/3779119020 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f25640e6b90 con 0x7f25741036d0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9dd84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 -- 172.21.15.16:0/1906348917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 msgr2=0x55b4a9dd7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 -- 172.21.15.16:0/1906348917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a9cff530 con 0x55b4a9a0f4d0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2572d9d640 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f257259c640 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9dd84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f256bfff640 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f255c009830 tx=0x7f255c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c419fa7b7ab2f3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2568ff9640 1 -- 172.21.15.16:0/1906348917 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c041020 con 0x55b4a9a0f4d0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2568ff9640 1 -- 172.21.15.16:0/1906348917 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c030dd0 con 0x55b4a9a0f4d0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2568ff9640 1 -- 172.21.15.16:0/1906348917 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c037040 con 0x55b4a9a0f4d0 2024-09-21T00:47:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.991+0000 7f2572d9d640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 0x7f25600b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f256c009a60 tx=0x7f256c004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:41.995 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:41.997 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:41.998 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:42.000 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- 172.21.15.16:0/1906348917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 msgr2=0x55b4a9dd9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f255c009830 tx=0x7f255c005d30 comp rx=0 tx=0).stop 2024-09-21T00:47:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- 172.21.15.16:0/1906348917 shutdown_connections 2024-09-21T00:47:42.004 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd9010 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9dd84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 --2- 172.21.15.16:0/1906348917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a301b0 0x55b4a9dd7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- 172.21.15.16:0/1906348917 >> 172.21.15.16:0/1906348917 conn(0x55b4a9a24300 msgr2=0x55b4a9dd38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- 172.21.15.16:0/1906348917 shutdown_connections 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- 172.21.15.16:0/1906348917 wait complete. 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 -- start start 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.993+0000 7f257f8d0740 1 Processor -- start 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 0x55b4a9de2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9c71ab0 con 0x55b4a9a072f0 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9cdf730 con 0x55b4a9a0f4d0 2024-09-21T00:47:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b4a9dd9ad0 con 0x55b4a9a301b0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257f8d0740 10 client.0 _ll_register_callbacks cb 0x55b4a9d336b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34216/0 (socket says 172.21.15.16:34216) 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 -- 172.21.15.16:0/2436807711 learned_addr learned my addr 172.21.15.16:0/2436807711 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f256bfff640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f2572d9d640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 0x55b4a9de2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 -- 172.21.15.16:0/2436807711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 msgr2=0x55b4a9de2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 0x55b4a9de2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 -- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 msgr2=0x55b4a9de1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f257259c640 1 -- 172.21.15.16:0/2436807711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a9a9b790 con 0x55b4a9a072f0 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f256bfff640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.994+0000 7f2572d9d640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 0x55b4a9de2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257259c640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f25640e4720 tx=0x7f2564014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4041211566c29793 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25640b1890 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f25640a90d0 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c030dd0 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2564009c30 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 10 client.15738 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4a9b14620 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c030dd0 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25640e4cd0 con 0x55b4a9a072f0 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 10 client.15738 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:42.007 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.995+0000 7f257f8d0740 20 client.15738 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a99eed80 0x55b4a9deedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f257f8d0740 4 client.15738 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4a9d4c640 con 0x55b4a99eed80 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f256bfff640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a99eed80 0x55b4a9deedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f256bfff640 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a99eed80 0x55b4a9deedd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c0ec15e294ce9 server_cookie=f779ebdaecf30e4a in_seq=0 out_seq=0 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.996+0000 7f2559ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f2559ffb640 1 -- 172.21.15.16:0/2436807711 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4a9d4c640 con 0x55b4a99eed80 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f2559ffb640 10 client.15738 handle_command_reply: tid=0 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 client.15738 shutdown 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 msgr2=0x55b4a9de1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f25640e4720 tx=0x7f2564014000 comp rx=0 tx=0).stop 2024-09-21T00:47:42.008 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 shutdown_connections 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a99eed80 0x55b4a9deedd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a301b0 0x55b4a9de2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f2559ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2436807711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9de1550 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 >> 172.21.15.16:0/2436807711 conn(0x55b4a9a24300 msgr2=0x55b4a9dd1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 shutdown_connections 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.997+0000 7f257f8d0740 1 -- 172.21.15.16:0/2436807711 wait complete. 2024-09-21T00:47:42.009 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:41.998+0000 7f257f8d0740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T00:47:42.009 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:42.009 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:42.014 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 Processor -- start 2024-09-21T00:47:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 -- start start 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a99eed80 0x55b4a9ddfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f255400e330 con 0x55b4a9a072f0 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f255400fe70 con 0x55b4a99eed80 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257f8d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f255400ea00 con 0x55b4a9a0f4d0 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34226/0 (socket says 172.21.15.16:34226) 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 -- 172.21.15.16:0/2761315808 learned_addr learned my addr 172.21.15.16:0/2761315808 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f2572d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f257259c640 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a99eed80 0x55b4a9ddfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 -- 172.21.15.16:0/2761315808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a0f4d0 msgr2=0x55b4a9dd3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 -- 172.21.15.16:0/2761315808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a99eed80 msgr2=0x55b4a9ddfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a99eed80 0x55b4a9ddfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.016+0000 7f256bfff640 1 -- 172.21.15.16:0/2761315808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a9de9a20 con 0x55b4a9a072f0 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.017+0000 7f256bfff640 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f255c005c90 tx=0x7f255c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9ad29e1c8de2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.017+0000 7f255bfff640 1 -- 172.21.15.16:0/2761315808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c054070 con 0x55b4a9a072f0 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.017+0000 7f255bfff640 1 -- 172.21.15.16:0/2761315808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c005500 con 0x55b4a9a072f0 2024-09-21T00:47:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.017+0000 7f255bfff640 1 -- 172.21.15.16:0/2761315808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c041040 con 0x55b4a9a072f0 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- 172.21.15.16:0/2761315808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 msgr2=0x55b4a9ddffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f255c005c90 tx=0x7f255c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- 172.21.15.16:0/2761315808 shutdown_connections 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9dd3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a9a072f0 0x55b4a9ddffa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 --2- 172.21.15.16:0/2761315808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a99eed80 0x55b4a9ddfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- 172.21.15.16:0/2761315808 >> 172.21.15.16:0/2761315808 conn(0x55b4a9a24300 msgr2=0x55b4a9de0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- 172.21.15.16:0/2761315808 shutdown_connections 2024-09-21T00:47:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- 172.21.15.16:0/2761315808 wait complete. 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:42.021 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-21T00:47:42.023 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:42.026 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:42.027 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 -- start start 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.018+0000 7f257f8d0740 1 Processor -- start 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9de94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f255400f7a0 con 0x55b4a99eed80 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f255400f0d0 con 0x55b4a9a0f4d0 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f255400c310 con 0x55b4a9a072f0 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257f8d0740 10 client.0 _ll_register_callbacks cb 0x7f2564005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:42.029 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34242/0 (socket says 172.21.15.16:34242) 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 -- 172.21.15.16:0/493975558 learned_addr learned my addr 172.21.15.16:0/493975558 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f256bfff640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9de94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f2572d9d640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 -- 172.21.15.16:0/493975558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 msgr2=0x55b4a9de94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9de94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 -- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 msgr2=0x55b4a9de7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 -- 172.21.15.16:0/493975558 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a9de2af0 con 0x55b4a99eed80 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f257259c640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f25640aa0d0 tx=0x7f2564094480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab20158ce28a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f2559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.019+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25640a94b0 con 0x55b4a99eed80 2024-09-21T00:47:42.030 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f2564009dd0 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c005500 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25640b1890 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 10 client.15744 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4a9de7200 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255c005500 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25640d4170 con 0x55b4a99eed80 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 10 client.15744 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 20 client.15744 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a9a301b0 0x55b4a9e5ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 4 client.15744 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4a9d480f0 con 0x55b4a9a301b0 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.020+0000 7f256bfff640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a9a301b0 0x55b4a9e5ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:42.031 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.021+0000 7f2559ffb640 10 client.15744 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.021+0000 7f256bfff640 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a9a301b0 0x55b4a9e5ba90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5103f314f0895cc5 server_cookie=f94dd6ad655ea883 in_seq=0 out_seq=0 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f2559ffb640 1 -- 172.21.15.16:0/493975558 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4a9d480f0 con 0x55b4a9a301b0 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f2559ffb640 10 client.15744 handle_command_reply: tid=0 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 client.15744 shutdown 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 msgr2=0x55b4a9de8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f25640aa0d0 tx=0x7f2564094480 comp rx=0 tx=0).stop 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 shutdown_connections 2024-09-21T00:47:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b4a9a301b0 0x55b4a9e5ba90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b4a9a0f4d0 0x55b4a9de7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f2559ffb640 0 client.15744 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4a9a072f0 0x55b4a9de94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 --2- 172.21.15.16:0/493975558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a99eed80 0x55b4a9de8e20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 >> 172.21.15.16:0/493975558 conn(0x55b4a9a24300 msgr2=0x55b4a9de0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 shutdown_connections 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 1 -- 172.21.15.16:0/493975558 wait complete. 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.034+0000 7f257f8d0740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:47:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:47:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:47:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:47:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 msgr2=0x7f25600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 0x7f25600b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f256c009a60 tx=0x7f256c004ab0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 msgr2=0x7f2574076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f256400d770 tx=0x7f256400dc30 comp rx=0 tx=0).stop 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 shutdown_connections 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f25600b6590 0x7f25600b8aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25741050f0 0x7f2574075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2574104750 0x7f2574075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 --2- 172.21.15.16:0/3779119020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25741036d0 0x7f2574076e50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 >> 172.21.15.16:0/3779119020 conn(0x7f25740ff030 msgr2=0x7f2574107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 shutdown_connections 2024-09-21T00:47:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:42.035+0000 7f2578962640 1 -- 172.21.15.16:0/3779119020 wait complete. 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:42.044 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:42.047 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:42.048 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:42.050 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:42.050 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:42.050 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:42.050 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:42.058 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:42.061 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:42.062 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:42.063 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:42.071 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:42.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:42.084 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-21T00:47:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T00:47:42.087 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:42.090 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:42.091 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:42.109 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:42.119 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:42.120 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:42.125 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:42.129 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:42.132 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:42.133 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:42.134 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:42.146 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T00:47:42.147 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-21T00:47:42.148 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:42.150 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:42.151 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:42.152 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:42.174 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:42.175 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:42.176 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:42.178 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:42.179 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:42.183 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:42.183 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:42.184 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:42.186 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:42.187 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:42.188 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:42.189 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:42.192 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:42.193 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:42.195 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:42.196 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:42.197 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:42.198 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T00:47:42.214 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:42.216 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:42.217 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:42.241 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:42.242 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:42.243 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:42.243 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:42.243 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:42.247 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:42.248 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:42.259 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:42.260 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:42.261 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-21T00:47:42.262 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T00:47:42.263 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-21T00:47:42.263 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T00:47:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:42.276 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:42.277 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:42.292 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:42.296 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:42.301 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:42.303 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:42.304 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:42.305 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:42.306 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:42.307 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:42.441 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:42.442 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:42.443 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:42.444 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:42.446 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:42.447 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T00:47:42.447 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:42.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:47:42.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:42.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:42.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T00:47:42.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:42.952 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:43.194 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:43.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T00:47:43.410 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:43.411 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:43.412 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T00:47:43.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:43 smithi016 ceph-mon[30947]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.39k op/s 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 -- 172.21.15.16:0/588081735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 msgr2=0x7f7ee8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 --2- 172.21.15.16:0/588081735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8102e70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009900 tx=0x7f7ed802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 -- 172.21.15.16:0/588081735 shutdown_connections 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 --2- 172.21.15.16:0/588081735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee8108cf0 0x7f7ee810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 --2- 172.21.15.16:0/588081735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee81083a0 0x7f7ee81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 --2- 172.21.15.16:0/588081735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8102e70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 -- 172.21.15.16:0/588081735 >> 172.21.15.16:0/588081735 conn(0x7f7ee8079730 msgr2=0x7f7ee8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 -- 172.21.15.16:0/588081735 shutdown_connections 2024-09-21T00:47:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.681+0000 7f7eee909640 1 -- 172.21.15.16:0/588081735 wait complete. 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 Processor -- start 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 -- start start 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8104410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee8108cf0 0x7f7ee8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8112960 con 0x7f7ee8102a60 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81127e0 con 0x7f7ee8108cf0 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.682+0000 7f7eee909640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8112ae0 con 0x7f7ee81083a0 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:54668/0 (socket says 172.21.15.16:54668) 2024-09-21T00:47:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2878655673 learned_addr learned my addr 172.21.15.16:0/2878655673 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7eecea6640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee8108cf0 0x7f7ee8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2878655673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee8108cf0 msgr2=0x7f7ee8104e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee8108cf0 0x7f7ee8104e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 msgr2=0x7f7ee8104410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8104410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2878655673 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee81a8720 con 0x7f7ee81083a0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.683+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e9c0 tx=0x7f7edc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7ee57fa640 1 -- 172.21.15.16:0/2878655673 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00cd80 con 0x7f7ee81083a0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7ee57fa640 1 -- 172.21.15.16:0/2878655673 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc0054d0 con 0x7f7ee81083a0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee81a8a10 con 0x7f7ee81083a0 2024-09-21T00:47:43.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7ee57fa640 1 -- 172.21.15.16:0/2878655673 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc010430 con 0x7f7ee81083a0 2024-09-21T00:47:43.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.684+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee81a8fa0 con 0x7f7ee81083a0 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ee57fa640 1 -- 172.21.15.16:0/2878655673 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7edc0105d0 con 0x7f7ee81083a0 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 Processor -- start 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 -- start start 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af59cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562c0aecfe50 con 0x562c0ab91390 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562c0aebf280 con 0x562c0ab891b0 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c0aec3090 con 0x562c0abb2070 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.687+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af59cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:54678/0 (socket says 172.21.15.16:54678) 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 -- 172.21.15.16:0/918266993 learned_addr learned my addr 172.21.15.16:0/918266993 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:50354/0 (socket says 172.21.15.16:50354) 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 -- 172.21.15.16:0/918266993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 msgr2=0x562c0af597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ee57fa640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 0x7f7ed00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 -- 172.21.15.16:0/918266993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 msgr2=0x562c0af59cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af59cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 -- 172.21.15.16:0/918266993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0ac1d650 con 0x562c0abb2070 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af59cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ee57fa640 1 -- 172.21.15.16:0/2878655673 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f7edc0e7700 con 0x7f7ee81083a0 2024-09-21T00:47:43.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 0x7f7ed00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7eecea6640 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009fd0 tx=0x7f7ee00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0aaaf2228f86c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.688+0000 7f7ece7fc640 1 -- 172.21.15.16:0/918266993 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0004250 con 0x562c0abb2070 2024-09-21T00:47:43.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ece7fc640 1 -- 172.21.15.16:0/918266993 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee0003db0 con 0x562c0abb2070 2024-09-21T00:47:43.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ece7fc640 1 -- 172.21.15.16:0/918266993 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee001bb80 con 0x562c0abb2070 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/918266993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 msgr2=0x562c0af59270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009fd0 tx=0x7f7ee00118d0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7eecea6640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 0x7f7ed00b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0020000 tx=0x7f7ee0021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/918266993 shutdown_connections 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af59cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.689+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/918266993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af59270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.690+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/918266993 >> 172.21.15.16:0/918266993 conn(0x562c0aba6460 msgr2=0x562c0af57160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.690+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/918266993 shutdown_connections 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.690+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/918266993 wait complete. 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.690+0000 7f7ef4e7d740 1 -- start start 2024-09-21T00:47:43.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.690+0000 7f7ef4e7d740 1 Processor -- start 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af64890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af64dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0af65330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562c0ad20700 con 0x562c0ab891b0 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562c0ae5a110 con 0x562c0abb2070 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c0af67a50 con 0x562c0ab91390 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af64890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af64dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af64890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34288/0 (socket says 172.21.15.16:34288) 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee7fff640 1 -- 172.21.15.16:0/1659466896 learned_addr learned my addr 172.21.15.16:0/1659466896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ef4e7d740 10 client.0 _ll_register_callbacks cb 0x562c0ae73990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7eecea6640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0af65330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 msgr2=0x562c0af65330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0af65330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1659466896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 msgr2=0x562c0af64890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af64890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1659466896 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0ae87c40 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af64dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0e52c0 tx=0x7f7edc0b71d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4997d6b978c65035 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.691+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0a97a0 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee0003db0 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f7edc0e7b80 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7edc0a9070 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 10 client.25435 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562c0af736f0 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee0003db0 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7edc0ac5d0 con 0x562c0ab91390 2024-09-21T00:47:43.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 10 client.25435 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 10 client.25435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 20 client.25435 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab709f0 0x562c0af76bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 4 client.25435 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.692+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c0aed1da0 con 0x562c0ab709f0 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.693+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab709f0 0x562c0af76bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.693+0000 7f7ec77fe640 10 client.25435 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.693+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab709f0 0x562c0af76bc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0aed504698e57c2 server_cookie=b59060ad5d378215 in_seq=0 out_seq=0 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1659466896 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c0aed1da0 con 0x562c0ab709f0 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ec77fe640 10 client.25435 handle_command_reply: tid=0 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 client.25435 shutdown 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 msgr2=0x562c0af64dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af64dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0e52c0 tx=0x7f7edc0b71d0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 shutdown_connections 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab709f0 0x562c0af76bc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0af65330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af64dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1659466896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af64890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 >> 172.21.15.16:0/1659466896 conn(0x562c0aba6460 msgr2=0x562c0af5c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ec77fe640 0 client.25435 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 shutdown_connections 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1659466896 wait complete. 2024-09-21T00:47:43.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.694+0000 7f7ef4e7d740 20 client.25435 trim_cache size 0 max 16384 2024-09-21T00:47:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.712+0000 7f7ef4e7d740 1 Processor -- start 2024-09-21T00:47:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.712+0000 7f7ef4e7d740 1 -- start start 2024-09-21T00:47:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af64d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af61a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b14f0 con 0x562c0ab91390 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b3030 con 0x562c0ab891b0 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b1bc0 con 0x562c0abb2070 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34292/0 (socket says 172.21.15.16:34292) 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2210827694 learned_addr learned my addr 172.21.15.16:0/2210827694 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7eecea6640 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af61a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af64d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2210827694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 msgr2=0x562c0af61a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af61a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2210827694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 msgr2=0x562c0af64d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af64d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 -- 172.21.15.16:0/2210827694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0af637f0 con 0x562c0ab91390 2024-09-21T00:47:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0aab70 tx=0x7f7edc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe2d92d4cb885cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.713+0000 7f7ecdffb640 1 -- 172.21.15.16:0/2210827694 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0c8070 con 0x562c0ab91390 2024-09-21T00:47:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.714+0000 7f7ecdffb640 1 -- 172.21.15.16:0/2210827694 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc0ae000 con 0x562c0ab91390 2024-09-21T00:47:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.714+0000 7f7ecdffb640 1 -- 172.21.15.16:0/2210827694 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0ad070 con 0x562c0ab91390 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.714+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/2210827694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 msgr2=0x562c0af56920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.714+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0aab70 tx=0x7f7edc005740 comp rx=0 tx=0).stop 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/2210827694 shutdown_connections 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0abb2070 0x562c0af61a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab91390 0x562c0af56920 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/2210827694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0ab891b0 0x562c0af64d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/2210827694 >> 172.21.15.16:0/2210827694 conn(0x562c0aba6460 msgr2=0x562c0af64640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/2210827694 shutdown_connections 2024-09-21T00:47:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/2210827694 wait complete. 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 -- start start 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.715+0000 7f7ef4e7d740 1 Processor -- start 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af6a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0afe8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b2960 con 0x562c0ab891b0 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b2290 con 0x562c0abb2070 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81af4d0 con 0x562c0ab91390 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ef4e7d740 10 client.0 _ll_register_callbacks cb 0x7f7edc0ed220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af6a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af6a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34296/0 (socket says 172.21.15.16:34296) 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee7fff640 1 -- 172.21.15.16:0/1617774763 learned_addr learned my addr 172.21.15.16:0/1617774763 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:43.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:54700/0 (socket says 172.21.15.16:54700) 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7eecea6640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0afe8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 msgr2=0x562c0afe8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0afe8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1617774763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 msgr2=0x562c0af6a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af6a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7ee77fe640 1 -- 172.21.15.16:0/1617774763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0af6b190 con 0x562c0ab91390 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.716+0000 7f7eecea6640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0afe8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ee77fe640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x562c0ae5d1d0 tx=0x7f7edc0b22e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2efa390b9f86134f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0c8070 con 0x562c0ab91390 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f7edc0051b0 con 0x562c0ab91390 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc0ae000 con 0x562c0ab91390 2024-09-21T00:47:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7edc0ad250 con 0x562c0ab91390 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 10 client.25441 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562c0af6b190 con 0x562c0ab91390 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc0ae000 con 0x562c0ab91390 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7edc0b3570 con 0x562c0ab91390 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 10 client.25441 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 10 client.25441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 20 client.25441 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab45da0 0x562c0afec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.717+0000 7f7ef4e7d740 4 client.25441 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.718+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c0aecd850 con 0x562c0ab45da0 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.718+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab45da0 0x562c0afec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.718+0000 7f7ee7fff640 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab45da0 0x562c0afec4a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88355f6eaf7ff09 server_cookie=e06c8a8cea49aa73 in_seq=0 out_seq=0 2024-09-21T00:47:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.718+0000 7f7ec77fe640 10 client.25441 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:43.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ec77fe640 1 -- 172.21.15.16:0/1617774763 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x562c0aecd850 con 0x562c0ab45da0 2024-09-21T00:47:43.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ec77fe640 10 client.25441 handle_command_reply: tid=0 2024-09-21T00:47:43.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 client.25441 shutdown 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 msgr2=0x562c0af6a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x562c0ae5d1d0 tx=0x7f7edc0b22e0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 shutdown_connections 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x562c0ab45da0 0x562c0afec4a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562c0abb2070 0x562c0afe8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c0ab91390 0x562c0af6a9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ec77fe640 0 client.25441 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 --2- 172.21.15.16:0/1617774763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562c0ab891b0 0x562c0af6a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 >> 172.21.15.16:0/1617774763 conn(0x562c0aba6460 msgr2=0x562c0af5c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 shutdown_connections 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.719+0000 7f7ef4e7d740 1 -- 172.21.15.16:0/1617774763 wait complete. 2024-09-21T00:47:43.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.720+0000 7f7ef4e7d740 20 client.25441 trim_cache size 0 max 16384 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "d3245a0c-cad6-40bc-9fe5-0818d28432a1": { 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:47:10.192603+0000", 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:47:43.726 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "b48866e0-3f81-43b8-b9d9-9af98dd7a373": { 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-21T00:46:23.778707+0000", 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:43.727 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.720+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 msgr2=0x7f7ed00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.720+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 0x7f7ed00b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0020000 tx=0x7f7ee0021000 comp rx=0 tx=0).stop 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.720+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 msgr2=0x7f7ee8104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.720+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e9c0 tx=0x7f7edc00ee80 comp rx=0 tx=0).stop 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 shutdown_connections 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f7ed00b6590 0x7f7ed00b8aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee8108cf0 0x7f7ee8104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee81083a0 0x7f7ee8104950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 --2- 172.21.15.16:0/2878655673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ee8102a60 0x7f7ee8104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:43.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 >> 172.21.15.16:0/2878655673 conn(0x7f7ee8079730 msgr2=0x7f7ee81067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:43.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 shutdown_connections 2024-09-21T00:47:43.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:43.721+0000 7f7eee909640 1 -- 172.21.15.16:0/2878655673 wait complete. 2024-09-21T00:47:43.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:43 smithi123 ceph-mon[34853]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.39k op/s 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:43.771 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T00:47:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T00:47:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:43.776 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:43.777 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T00:47:43.777 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:43.777 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:43.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:43 smithi178 ceph-mon[34888]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.4 MiB/s wr, 2.39k op/s 2024-09-21T00:47:44.237 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:44.237 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T00:47:44.237 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:44.237 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:44.238 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:44.239 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T00:47:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:44.242 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:44.598 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:47:44.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:44.764 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:44.766 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:44.768 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T00:47:44.769 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:44.770 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:44.770 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:44.770 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T00:47:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:45.159 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T00:47:45.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:45.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:45.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 -- 172.21.15.16:0/3665372936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098108cf0 msgr2=0x7f609810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 --2- 172.21.15.16:0/3665372936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098108cf0 0x7f609810f520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6090009ca0 tx=0x7f609002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 -- 172.21.15.16:0/3665372936 shutdown_connections 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 --2- 172.21.15.16:0/3665372936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098108cf0 0x7f609810f520 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 --2- 172.21.15.16:0/3665372936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 0x7f60981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 --2- 172.21.15.16:0/3665372936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098102a60 0x7f6098102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 -- 172.21.15.16:0/3665372936 >> 172.21.15.16:0/3665372936 conn(0x7f6098079730 msgr2=0x7f6098079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 -- 172.21.15.16:0/3665372936 shutdown_connections 2024-09-21T00:47:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.507+0000 7f60a0451640 1 -- 172.21.15.16:0/3665372936 wait complete. 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 Processor -- start 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 -- start start 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 0x7f609819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 0x7f60981a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6098112960 con 0x7f6098102a60 2024-09-21T00:47:45.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60981127e0 con 0x7f60981083a0 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f60a0451640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6098112ae0 con 0x7f6098108cf0 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f609e1ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f609e1ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53394/0 (socket says 172.21.15.16:53394) 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f609e1ed640 1 -- 172.21.15.16:0/2633657473 learned_addr learned my addr 172.21.15.16:0/2633657473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f609d9ec640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 0x7f609819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.508+0000 7f609e9ee640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 0x7f60981a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 -- 172.21.15.16:0/2633657473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 msgr2=0x7f60981a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 0x7f60981a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 -- 172.21.15.16:0/2633657473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 msgr2=0x7f609819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 0x7f609819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 -- 172.21.15.16:0/2633657473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60981a2580 con 0x7f6098102a60 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e9ee640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 0x7f60981a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f609e1ed640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f609400e9f0 tx=0x7f609400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609400cd80 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60940054d0 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60981a2870 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094010690 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.509+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981a8fd0 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.510+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6098102e70 con 0x7f6098102a60 2024-09-21T00:47:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.512+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6094004e90 con 0x7f6098102a60 2024-09-21T00:47:45.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.513+0000 7f608f7fe640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 0x7f60840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:45.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.513+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f60940e76f0 con 0x7f6098102a60 2024-09-21T00:47:45.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.513+0000 7f609d9ec640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 0x7f60840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:45.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.513+0000 7f609d9ec640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 0x7f60840b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f609806a450 tx=0x7f6088005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:45.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.518+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60940ae010 con 0x7f6098102a60 2024-09-21T00:47:45.542 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:45.542 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T00:47:45.542 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:45.543 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:45.544 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:45.545 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:45.546 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:45.547 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T00:47:45.548 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:45.548 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:45.548 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:45.548 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T00:47:45.548 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:45.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:45 smithi016 ceph-mon[30947]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 3.08k op/s 2024-09-21T00:47:45.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:45 smithi123 ceph-mon[34853]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 3.08k op/s 2024-09-21T00:47:45.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.771+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f609819d740 con 0x7f6098102a60 2024-09-21T00:47:45.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.772+0000 7f608f7fe640 1 -- 172.21.15.16:0/2633657473 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f60940b23f0 con 0x7f6098102a60 2024-09-21T00:47:45.774 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:47:45.774 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:47:45.775 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:47:45.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 msgr2=0x7f60840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:45.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 0x7f60840b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f609806a450 tx=0x7f6088005f90 comp rx=0 tx=0).stop 2024-09-21T00:47:45.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 msgr2=0x7f609819c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f609400e9f0 tx=0x7f609400edf0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 shutdown_connections 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f60840b6510 0x7f60840b8a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6098108cf0 0x7f60981a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60981083a0 0x7f609819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 --2- 172.21.15.16:0/2633657473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6098102a60 0x7f609819c610 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 >> 172.21.15.16:0/2633657473 conn(0x7f6098079730 msgr2=0x7f609806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 shutdown_connections 2024-09-21T00:47:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:45.775+0000 7f60a0451640 1 -- 172.21.15.16:0/2633657473 wait complete. 2024-09-21T00:47:45.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:45 smithi178 ceph-mon[34888]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 3.08k op/s 2024-09-21T00:47:46.045 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:46.045 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T00:47:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:46.048 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T00:47:46.049 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T00:47:46.051 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:46.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T00:47:46.511 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:46.512 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:46.513 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T00:47:46.514 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:46.515 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T00:47:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:46.517 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:46.707 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:46.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:46 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2633657473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:46.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:46 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2633657473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:46.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:46 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2633657473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:47:46.868 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:46.869 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:46.870 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:46.872 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:46.874 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:47.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 -- 172.21.15.16:0/2251191642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 msgr2=0x7f0fa8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 --2- 172.21.15.16:0/2251191642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8103f90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009900 tx=0x7f0f9802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 -- 172.21.15.16:0/2251191642 shutdown_connections 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 --2- 172.21.15.16:0/2251191642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa8109e10 0x7f0fa8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 --2- 172.21.15.16:0/2251191642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa81094c0 0x7f0fa81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 --2- 172.21.15.16:0/2251191642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8103f90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 -- 172.21.15.16:0/2251191642 >> 172.21.15.16:0/2251191642 conn(0x7f0fa80ff610 msgr2=0x7f0fa8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 -- 172.21.15.16:0/2251191642 shutdown_connections 2024-09-21T00:47:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.220+0000 7f0fac97f640 1 -- 172.21.15.16:0/2251191642 wait complete. 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.221+0000 7f0fac97f640 1 Processor -- start 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.221+0000 7f0fac97f640 1 -- start start 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa81094c0 0x7f0fa8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 0x7f0fa8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8113ad0 con 0x7f0fa8103b80 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8113950 con 0x7f0fa8109e10 2024-09-21T00:47:47.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fac97f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8113c50 con 0x7f0fa81094c0 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53408/0 (socket says 172.21.15.16:53408) 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 -- 172.21.15.16:0/3097839583 learned_addr learned my addr 172.21.15.16:0/3097839583 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 0x7f0fa8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa81094c0 0x7f0fa8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 -- 172.21.15.16:0/3097839583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa81094c0 msgr2=0x7f0fa8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa81094c0 0x7f0fa8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 -- 172.21.15.16:0/3097839583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 msgr2=0x7f0fa8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 0x7f0fa8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 -- 172.21.15.16:0/3097839583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa81a8780 con 0x7f0fa8103b80 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 0x7f0fa8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.222+0000 7f0fa659c640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005940 tx=0x7f0f980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.223+0000 7f0f977fe640 1 -- 172.21.15.16:0/3097839583 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9803f030 con 0x7f0fa8103b80 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.223+0000 7f0f977fe640 1 -- 172.21.15.16:0/3097839583 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980044c0 con 0x7f0fa8103b80 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.223+0000 7f0f977fe640 1 -- 172.21.15.16:0/3097839583 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98035070 con 0x7f0fa8103b80 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.223+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa81a8a10 con 0x7f0fa8103b80 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.223+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a8ea0 con 0x7f0fa8103b80 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 Processor -- start 2024-09-21T00:47:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0f977fe640 1 -- 172.21.15.16:0/3097839583 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0f98042030 con 0x7f0fa8103b80 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 -- start start 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a03047b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a03047b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a03047bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a0303f1ea0 con 0x55a0300b3390 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a0303e12d0 con 0x55a0300d4070 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a0303e50e0 con 0x55a0300ab1b0 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fa5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a03047bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.226+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a03047b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a03047bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53412/0 (socket says 172.21.15.16:53412) 2024-09-21T00:47:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa5d9b640 1 -- 172.21.15.16:0/549264995 learned_addr learned my addr 172.21.15.16:0/549264995 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a03047b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 -- 172.21.15.16:0/549264995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 msgr2=0x55a03047b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a03047b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 -- 172.21.15.16:0/549264995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 msgr2=0x55a03047bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a03047bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 -- 172.21.15.16:0/549264995 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03013f650 con 0x55a0300ab1b0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0f977fe640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 0x7f0f900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa659c640 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a03047b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f98105120 tx=0x7f0f9810dcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a89f0d6c2229dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.227+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 0x7f0f900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.228+0000 7f0f94ff9640 1 -- 172.21.15.16:0/549264995 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980d2020 con 0x55a0300ab1b0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.228+0000 7f0f94ff9640 1 -- 172.21.15.16:0/549264995 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f98046eb0 con 0x55a0300ab1b0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.228+0000 7f0f977fe640 1 -- 172.21.15.16:0/3097839583 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f0f981075c0 con 0x7f0fa8103b80 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.228+0000 7f0f94ff9640 1 -- 172.21.15.16:0/549264995 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980cd660 con 0x55a0300ab1b0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/549264995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 msgr2=0x55a03047b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 0x7f0f900b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005fd0 tx=0x7f0fa0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a03047b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f98105120 tx=0x7f0f9810dcb0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/549264995 shutdown_connections 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a03047bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a03047b800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/549264995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a03047b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/549264995 >> 172.21.15.16:0/549264995 conn(0x55a0300c8460 msgr2=0x55a0304791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/549264995 shutdown_connections 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/549264995 wait complete. 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 -- start start 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.229+0000 7f0fb2ef3740 1 Processor -- start 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a030486dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030487300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a030242700 con 0x55a0300b3390 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a03037c160 con 0x55a0300d4070 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a030489860 con 0x55a0300ab1b0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fb2ef3740 10 client.0 _ll_register_callbacks cb 0x55a0303959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a030486dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030487300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48022/0 (socket says 172.21.15.16:48022) 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 -- 172.21.15.16:0/1587853070 learned_addr learned my addr 172.21.15.16:0/1587853070 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 -- 172.21.15.16:0/1587853070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 msgr2=0x55a030487300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030487300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 -- 172.21.15.16:0/1587853070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 msgr2=0x55a030486dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a030486dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.230+0000 7f0fa659c640 1 -- 172.21.15.16:0/1587853070 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0303a9c90 con 0x55a0300ab1b0 2024-09-21T00:47:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f980cd820 tx=0x7f0f98005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bf5f4c6116bf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98082370 con 0x55a0300ab1b0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f0f980810b0 con 0x55a0300ab1b0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0303f3df0 con 0x55a0300ab1b0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f98049050 con 0x55a0300ab1b0 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0fb2ef3740 10 client.25459 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0304953c0 con 0x55a0300ab1b0 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.231+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a0303f3df0 con 0x55a0300ab1b0 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f9810d640 con 0x55a0300ab1b0 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 10 client.25459 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 10 client.25459 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 20 client.25459 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a0300929f0 0x55a030498720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 4 client.25459 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0303ef8a0 con 0x55a0300929f0 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a0300929f0 0x55a030498720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a0300929f0 0x55a030498720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6bf21ce818c8ca08 server_cookie=643b6b1460f9ded6 in_seq=0 out_seq=0 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.232+0000 7f0f8dffb640 10 client.25459 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1587853070 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0303ef8a0 con 0x55a0300929f0 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0f8dffb640 10 client.25459 handle_command_reply: tid=0 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 client.25459 shutdown 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 msgr2=0x55a030486880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f980cd820 tx=0x7f0f98005c90 comp rx=0 tx=0).stop 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 shutdown_connections 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a0300929f0 0x55a030498720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030487300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300b3390 0x55a030486dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1587853070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300ab1b0 0x55a030486880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 >> 172.21.15.16:0/1587853070 conn(0x55a0300c8460 msgr2=0x55a03047e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0f8dffb640 0 client.25459 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 shutdown_connections 2024-09-21T00:47:47.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1587853070 wait complete. 2024-09-21T00:47:47.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.234+0000 7f0fb2ef3740 20 client.25459 trim_cache size 0 max 16384 2024-09-21T00:47:47.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 Processor -- start 2024-09-21T00:47:47.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 -- start start 2024-09-21T00:47:47.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03047cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030480ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81b13a0 con 0x55a0300ab1b0 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81b2ee0 con 0x55a0300d4070 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.250+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81b1a70 con 0x55a0300b3390 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03047cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48038/0 (socket says 172.21.15.16:48038) 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 -- 172.21.15.16:0/620422385 learned_addr learned my addr 172.21.15.16:0/620422385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03047cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53426/0 (socket says 172.21.15.16:53426) 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030480ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 -- 172.21.15.16:0/620422385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 msgr2=0x55a030480ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030480ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 -- 172.21.15.16:0/620422385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 msgr2=0x55a03047cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03047cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 -- 172.21.15.16:0/620422385 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0304796f0 con 0x55a0300b3390 2024-09-21T00:47:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009fd0 tx=0x7f0f9c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece8065ab655eacd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0f8ffff640 1 -- 172.21.15.16:0/620422385 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c029070 con 0x55a0300b3390 2024-09-21T00:47:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0f8ffff640 1 -- 172.21.15.16:0/620422385 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f9c01fb70 con 0x55a0300b3390 2024-09-21T00:47:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.251+0000 7f0f8ffff640 1 -- 172.21.15.16:0/620422385 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c024c10 con 0x55a0300b3390 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.252+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/620422385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 msgr2=0x55a030488760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.252+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009fd0 tx=0x7f0f9c005f90 comp rx=0 tx=0).stop 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.252+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/620422385 shutdown_connections 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.252+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300d4070 0x55a030480ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300b3390 0x55a030488760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/620422385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03047cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/620422385 >> 172.21.15.16:0/620422385 conn(0x55a0300c8460 msgr2=0x55a0304803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/620422385 shutdown_connections 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/620422385 wait complete. 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 -- start start 2024-09-21T00:47:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.253+0000 7f0fb2ef3740 1 Processor -- start 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 0x55a03048b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 0x55a03048b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81b2810 con 0x55a0300ab1b0 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81b2140 con 0x55a0300b3390 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81af3a0 con 0x55a0300d4070 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fb2ef3740 10 client.0 _ll_register_callbacks cb 0x7f0f9c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53438/0 (socket says 172.21.15.16:53438) 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 -- 172.21.15.16:0/1626604798 learned_addr learned my addr 172.21.15.16:0/1626604798 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 0x55a03048b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 0x55a03048b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 -- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 msgr2=0x55a03048b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 0x55a03048b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 -- 172.21.15.16:0/1626604798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 msgr2=0x55a03048b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 0x55a03048b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa659c640 1 -- 172.21.15.16:0/1626604798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0305021e0 con 0x55a0300ab1b0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa6d9d640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 0x55a03048b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.254+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 0x55a03048b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0fa659c640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f9803d040 tx=0x7f0f9810dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ae40dea791e5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98082ab0 con 0x55a0300ab1b0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f0f980d6d70 con 0x55a0300ab1b0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f9c01fb70 con 0x55a0300ab1b0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f98082c80 con 0x55a0300ab1b0 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0fb2ef3740 10 client.15786 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:47.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0305021e0 con 0x55a0300ab1b0 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.255+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f9c01fb70 con 0x55a0300ab1b0 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f980ceb10 con 0x55a0300ab1b0 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 10 client.15786 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 10 client.15786 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 20 client.15786 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a030067da0 0x55a030505830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 4 client.15786 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 --> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0303eccd0 con 0x55a030067da0 2024-09-21T00:47:47.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a030067da0 0x55a030505830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0f8dffb640 10 client.15786 ms_handle_connect on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.256+0000 7f0fa5d9b640 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a030067da0 0x55a030505830 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=84d22c2e715ee4ba server_cookie=2b22c8afc4c080c6 in_seq=0 out_seq=0 2024-09-21T00:47:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0f8dffb640 1 -- 172.21.15.16:0/1626604798 <== mds.4 v2:172.21.15.178:6836/795211231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0303eccd0 con 0x55a030067da0 2024-09-21T00:47:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0f8dffb640 10 client.15786 handle_command_reply: tid=0 2024-09-21T00:47:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 client.15786 shutdown 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 msgr2=0x55a03048ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f9803d040 tx=0x7f0f9810dcb0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 shutdown_connections 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:6836/795211231,v1:172.21.15.178:6837/795211231] conn(0x55a030067da0 0x55a030505830 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0300d4070 0x55a03048b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a0300b3390 0x55a03048b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 --2- 172.21.15.16:0/1626604798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a0300ab1b0 0x55a03048ab40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 >> 172.21.15.16:0/1626604798 conn(0x55a0300c8460 msgr2=0x55a0304803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0f8dffb640 0 client.15786 ms_handle_reset on v2:172.21.15.178:6836/795211231 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 shutdown_connections 2024-09-21T00:47:47.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 1 -- 172.21.15.16:0/1626604798 wait complete. 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:47.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:47.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:47.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:47.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T00:47:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:47.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T00:47:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.257+0000 7f0fb2ef3740 20 client.15786 trim_cache size 0 max 16384 2024-09-21T00:47:47.270 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:47.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 msgr2=0x7f0f900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 0x7f0f900b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005fd0 tx=0x7f0fa0009500 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 msgr2=0x7f0fa8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0f98005940 tx=0x7f0f980040c0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 shutdown_connections 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f0f900b6510 0x7f0f900b8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa8109e10 0x7f0fa8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa81094c0 0x7f0fa8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 --2- 172.21.15.16:0/3097839583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa8103b80 0x7f0fa8075710 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 >> 172.21.15.16:0/3097839583 conn(0x7f0fa80ff610 msgr2=0x7f0fa8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 shutdown_connections 2024-09-21T00:47:47.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:47.258+0000 7f0fac97f640 1 -- 172.21.15.16:0/3097839583 wait complete. 2024-09-21T00:47:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:47.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T00:47:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:47.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:47.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T00:47:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:47.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:47 smithi016 ceph-mon[30947]: pgmap v395: 97 pgs: 97 active+clean; 237 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 1.5 MiB/s wr, 2.42k op/s 2024-09-21T00:47:47.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:47 smithi123 ceph-mon[34853]: pgmap v395: 97 pgs: 97 active+clean; 237 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 1.5 MiB/s wr, 2.42k op/s 2024-09-21T00:47:47.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:47 smithi178 ceph-mon[34888]: pgmap v395: 97 pgs: 97 active+clean; 237 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s rd, 1.5 MiB/s wr, 2.42k op/s 2024-09-21T00:47:47.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T00:47:48.179 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:48.179 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:48.179 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T00:47:48.179 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:48.179 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T00:47:48.180 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T00:47:48.181 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:48.182 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:48.183 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T00:47:48.184 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:48.221 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:48.568 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:48.569 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:48.571 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:48.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:48.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:48.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 -- 172.21.15.16:0/2292766104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 msgr2=0x7f620c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 --2- 172.21.15.16:0/2292766104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c102ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6208009900 tx=0x7f620802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 -- 172.21.15.16:0/2292766104 shutdown_connections 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 --2- 172.21.15.16:0/2292766104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 0x7f620c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 --2- 172.21.15.16:0/2292766104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 --2- 172.21.15.16:0/2292766104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c102ef0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 -- 172.21.15.16:0/2292766104 >> 172.21.15.16:0/2292766104 conn(0x7f620c079770 msgr2=0x7f620c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 -- 172.21.15.16:0/2292766104 shutdown_connections 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.732+0000 7f62144c3640 1 -- 172.21.15.16:0/2292766104 wait complete. 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.733+0000 7f62144c3640 1 Processor -- start 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.733+0000 7f62144c3640 1 -- start start 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 0x7f620c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f620c112a30 con 0x7f620c102ae0 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1128b0 con 0x7f620c108d70 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f62144c3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f620c112bb0 con 0x7f620c108420 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f621225f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48074/0 (socket says 172.21.15.16:48074) 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f6211a5e640 1 -- 172.21.15.16:0/2002893344 learned_addr learned my addr 172.21.15.16:0/2002893344 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.734+0000 7f6212a60640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 0x7f620c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 -- 172.21.15.16:0/2002893344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 msgr2=0x7f620c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 0x7f620c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 -- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 msgr2=0x7f620c1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c1994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 -- 172.21.15.16:0/2002893344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c19f450 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f621225f640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00e9c0 tx=0x7f61fc00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f62037fe640 1 -- 172.21.15.16:0/2002893344 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc00ccc0 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f62037fe640 1 -- 172.21.15.16:0/2002893344 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61fc0054d0 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f62037fe640 1 -- 172.21.15.16:0/2002893344 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc010430 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c19f740 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.735+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c1a5ea0 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.738+0000 7f62037fe640 1 -- 172.21.15.16:0/2002893344 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f61fc004f40 con 0x7f620c108420 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 Processor -- start 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 -- start start 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c82f070 0x561c6cbd62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbd6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561c6cb4cea0 con 0x561c6c80e390 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561c6cb3c2d0 con 0x561c6c8061b0 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621aa37740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561c6cb400e0 con 0x561c6c82f070 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbd6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621225f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f6212a60640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c82f070 0x561c6cbd62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621225f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:33138/0 (socket says 172.21.15.16:33138) 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f621225f640 1 -- 172.21.15.16:0/1196499849 learned_addr learned my addr 172.21.15.16:0/1196499849 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.739+0000 7f62037fe640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 0x7f61f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6212a60640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 0x7f61f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 -- 172.21.15.16:0/1196499849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c82f070 msgr2=0x561c6cbd62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c82f070 0x561c6cbd62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 -- 172.21.15.16:0/1196499849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 msgr2=0x561c6cbd6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbd6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 -- 172.21.15.16:0/1196499849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6c89a650 con 0x561c6c8061b0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f62037fe640 1 -- 172.21.15.16:0/2002893344 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f61fc0e7670 con 0x7f620c108420 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6211a5e640 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbd6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f621225f640 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6208009900 tx=0x7f6208005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc50f51cdcd77fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6212a60640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 0x7f61f80b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62040094d0 tx=0x7f6204004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6200d9a640 1 -- 172.21.15.16:0/1196499849 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208040070 con 0x561c6c8061b0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6200d9a640 1 -- 172.21.15.16:0/1196499849 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6208031720 con 0x561c6c8061b0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.740+0000 7f6200d9a640 1 -- 172.21.15.16:0/1196499849 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208035040 con 0x561c6c8061b0 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 -- 172.21.15.16:0/1196499849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 msgr2=0x561c6cbd6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6208009900 tx=0x7f6208005e20 comp rx=0 tx=0).stop 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 -- 172.21.15.16:0/1196499849 shutdown_connections 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbd6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbd6800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 --2- 172.21.15.16:0/1196499849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c82f070 0x561c6cbd62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 -- 172.21.15.16:0/1196499849 >> 172.21.15.16:0/1196499849 conn(0x561c6c823460 msgr2=0x561c6cbd41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 -- 172.21.15.16:0/1196499849 shutdown_connections 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.742+0000 7f621aa37740 1 -- 172.21.15.16:0/1196499849 wait complete. 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 -- start start 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 Processor -- start 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 0x561c6cbe4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbe45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561c6c99d700 con 0x561c6c82f070 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561c6cad7160 con 0x561c6c80e390 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561c6cbe6ba0 con 0x561c6c8061b0 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.743+0000 7f621aa37740 10 client.0 _ll_register_callbacks cb 0x561c6caf09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f6212a60640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbe45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48094/0 (socket says 172.21.15.16:48094) 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 -- 172.21.15.16:0/2430794723 learned_addr learned my addr 172.21.15.16:0/2430794723 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 0x561c6cbe4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 -- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 msgr2=0x561c6cbe4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 0x561c6cbe4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 -- 172.21.15.16:0/2430794723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 msgr2=0x561c6cbe45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbe45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 -- 172.21.15.16:0/2430794723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6cb04c90 con 0x561c6c8061b0 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 0x561c6cbe4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f6212a60640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbe45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f621225f640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f620802a930 tx=0x7f62080053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ff671079929907 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f61f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.744+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620804b070 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6208031720 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f6208004480 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6208057050 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 10 client.25477 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c6cbdc5f0 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6208031720 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f620803c440 con 0x561c6c8061b0 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 10 client.25477 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 10 client.25477 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 20 client.25477 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7ed9f0 0x561c6cbdda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 4 client.25477 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.745+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c6cb4edf0 con 0x561c6c7ed9f0 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.746+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7ed9f0 0x561c6cbdda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.746+0000 7f61f5ffb640 10 client.25477 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.746+0000 7f6211a5e640 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7ed9f0 0x561c6cbdda00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4de630374f61fd1 server_cookie=4d818b02b195cc52 in_seq=0 out_seq=0 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f61f5ffb640 1 -- 172.21.15.16:0/2430794723 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c6cb4edf0 con 0x561c6c7ed9f0 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f61f5ffb640 10 client.25477 handle_command_reply: tid=0 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 client.25477 shutdown 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 msgr2=0x561c6cbe3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f620802a930 tx=0x7f62080053f0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 shutdown_connections 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7ed9f0 0x561c6cbdda00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbe45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c80e390 0x561c6cbe4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 --2- 172.21.15.16:0/2430794723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe3b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f61f5ffb640 0 client.25477 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 >> 172.21.15.16:0/2430794723 conn(0x561c6c823460 msgr2=0x561c6cbd7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 shutdown_connections 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.747+0000 7f621aa37740 1 -- 172.21.15.16:0/2430794723 wait complete. 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.748+0000 7f621aa37740 20 client.25477 trim_cache size 0 max 16384 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 Processor -- start 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 -- start start 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbe3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 0x561c6cbdda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1ad040 con 0x561c6c80e390 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.762+0000 7f621aa37740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1aeb80 con 0x561c6c82f070 2024-09-21T00:47:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f621aa37740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1ad710 con 0x561c6c8061b0 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbe3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f621225f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 0x561c6cbdda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f621225f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48098/0 (socket says 172.21.15.16:48098) 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbe3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53492/0 (socket says 172.21.15.16:53492) 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f621225f640 1 -- 172.21.15.16:0/2757212322 learned_addr learned my addr 172.21.15.16:0/2757212322 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 -- 172.21.15.16:0/2757212322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 msgr2=0x561c6cbe38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 -- 172.21.15.16:0/2757212322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 msgr2=0x561c6cbe3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbe3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 -- 172.21.15.16:0/2757212322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6cbe4de0 con 0x561c6c82f070 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f6212a60640 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 0x561c6cbdda00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x561c6cbe4b00 tx=0x7f6204015070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b614ecb559c5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.763+0000 7f61f7fff640 1 -- 172.21.15.16:0/2757212322 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204022c90 con 0x561c6c82f070 2024-09-21T00:47:48.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.764+0000 7f61f7fff640 1 -- 172.21.15.16:0/2757212322 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6204022e30 con 0x561c6c82f070 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.764+0000 7f61f7fff640 1 -- 172.21.15.16:0/2757212322 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204005280 con 0x561c6c82f070 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.764+0000 7f621aa37740 1 -- 172.21.15.16:0/2757212322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 msgr2=0x561c6cbdda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.764+0000 7f621aa37740 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 0x561c6cbdda00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x561c6cbe4b00 tx=0x7f6204015070 comp rx=0 tx=0).stop 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- 172.21.15.16:0/2757212322 shutdown_connections 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c82f070 0x561c6cbdda00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c80e390 0x561c6cbe3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- 172.21.15.16:0/2757212322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c8061b0 0x561c6cbe38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- 172.21.15.16:0/2757212322 >> 172.21.15.16:0/2757212322 conn(0x561c6c823460 msgr2=0x561c6cbe23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- 172.21.15.16:0/2757212322 shutdown_connections 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- 172.21.15.16:0/2757212322 wait complete. 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- start start 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 Processor -- start 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbf6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 0x561c6cbf6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbf74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1ae4b0 con 0x561c6c82f070 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1adde0 con 0x561c6c8061b0 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1ab040 con 0x561c6c80e390 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.765+0000 7f621aa37740 10 client.0 _ll_register_callbacks cb 0x7f61fc0a9e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f621225f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbf6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6212a60640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbf74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 0x561c6cbf6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f621225f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbf6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:33160/0 (socket says 172.21.15.16:33160) 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f621225f640 1 -- 172.21.15.16:0/3464464853 learned_addr learned my addr 172.21.15.16:0/3464464853 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 -- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 msgr2=0x561c6cbf6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbf6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 -- 172.21.15.16:0/3464464853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 msgr2=0x561c6cbf74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbf74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 -- 172.21.15.16:0/3464464853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6cc5cc50 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6212a60640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbf74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f6211a5e640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 0x561c6cbf6f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0aaa60 tx=0x7f61fc0ad200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60367d1f31c8b2e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f61f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0ad300 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.766+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f61fc0e9b30 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6204022e30 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f61fc005680 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 10 client.25483 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c6cc5df10 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6204022e30 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f61fc0aeb20 con 0x561c6c80e390 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 10 client.25483 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 10 client.25483 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-21T00:47:48.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 20 client.25483 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7c2da0 0x561c6cc606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 4 client.25483 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 --> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c6cb4a8a0 con 0x561c6c7c2da0 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.767+0000 7f621225f640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7c2da0 0x561c6cc606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f61f5ffb640 10 client.25483 ms_handle_connect on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f621225f640 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7c2da0 0x561c6cc606d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cb25c8738e826cc1 server_cookie=46fdbcf05d08bcca in_seq=0 out_seq=0 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f61f5ffb640 1 -- 172.21.15.16:0/3464464853 <== mds.3 v2:172.21.15.123:6834/1315446944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c6cb4a8a0 con 0x561c6c7c2da0 2024-09-21T00:47:48.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f61f5ffb640 10 client.25483 handle_command_reply: tid=0 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f621aa37740 1 client.25483 shutdown 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 msgr2=0x561c6cbf6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.768+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 0x561c6cbf6f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0aaa60 tx=0x7f61fc0ad200 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 shutdown_connections 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:6834/1315446944,v1:172.21.15.123:6835/1315446944] conn(0x561c6c7c2da0 0x561c6cc606d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561c6c82f070 0x561c6cbf74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c6c80e390 0x561c6cbf6f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 --2- 172.21.15.16:0/3464464853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561c6c8061b0 0x561c6cbf6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f61f5ffb640 0 client.25483 ms_handle_reset on v2:172.21.15.123:6834/1315446944 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 >> 172.21.15.16:0/3464464853 conn(0x561c6c823460 msgr2=0x561c6cbdda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 shutdown_connections 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 1 -- 172.21.15.16:0/3464464853 wait complete. 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f621aa37740 20 client.25483 trim_cache size 0 max 16384 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 msgr2=0x7f61f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 0x7f61f80b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62040094d0 tx=0x7f6204004ab0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 msgr2=0x7f620c199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.769+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00e9c0 tx=0x7f61fc00edc0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 shutdown_connections 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f61f80b6590 0x7f61f80b8aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f620c108d70 0x7f620c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f620c108420 0x7f620c199a80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 --2- 172.21.15.16:0/2002893344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f620c102ae0 0x7f620c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 >> 172.21.15.16:0/2002893344 conn(0x7f620c079770 msgr2=0x7f620c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 shutdown_connections 2024-09-21T00:47:48.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:48.770+0000 7f62144c3640 1 -- 172.21.15.16:0/2002893344 wait complete. 2024-09-21T00:47:48.963 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:48.963 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T00:47:48.963 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:48.963 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:48.963 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T00:47:48.964 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:48.965 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:48.966 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:48.967 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:48.968 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:48.969 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:48.969 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T00:47:48.969 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:48.969 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:48.969 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:49.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:49.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T00:47:49.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:49.489 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T00:47:49.490 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:49.491 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T00:47:49.755 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:49 smithi016 ceph-mon[30947]: pgmap v396: 97 pgs: 97 active+clean; 303 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 1.3 MiB/s wr, 2.54k op/s 2024-09-21T00:47:49.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:49 smithi123 ceph-mon[34853]: pgmap v396: 97 pgs: 97 active+clean; 303 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 1.3 MiB/s wr, 2.54k op/s 2024-09-21T00:47:49.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T00:47:49.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:49 smithi178 ceph-mon[34888]: pgmap v396: 97 pgs: 97 active+clean; 303 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 1.3 MiB/s wr, 2.54k op/s 2024-09-21T00:47:49.845 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:49.845 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:49.845 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:49.845 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:49.848 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T00:47:49.849 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:49.850 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:49.851 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T00:47:49.851 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:49.851 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:49.851 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:49.851 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T00:47:50.101 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:50.204 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:50.205 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:50.206 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:50.207 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:50.208 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T00:47:50.209 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T00:47:50.751 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:50.752 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:50.753 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T00:47:50.754 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:50.755 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:50.756 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:50.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T00:47:50.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:50.757 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:50.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 -- 172.21.15.16:0/1239349163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108420 msgr2=0x7fbd68108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 --2- 172.21.15.16:0/1239349163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108420 0x7fbd68108830 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009900 tx=0x7fbd5802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 -- 172.21.15.16:0/1239349163 shutdown_connections 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 --2- 172.21.15.16:0/1239349163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68108d70 0x7fbd6810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 --2- 172.21.15.16:0/1239349163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108420 0x7fbd68108830 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 --2- 172.21.15.16:0/1239349163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd68102ae0 0x7fbd68102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 -- 172.21.15.16:0/1239349163 >> 172.21.15.16:0/1239349163 conn(0x7fbd68079770 msgr2=0x7fbd68079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 -- 172.21.15.16:0/1239349163 shutdown_connections 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.852+0000 7fbd70305640 1 -- 172.21.15.16:0/1239349163 wait complete. 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 Processor -- start 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 -- start start 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68102ae0 0x7fbd6819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd68108420 0x7fbd6819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68113b50 con 0x7fbd68108d70 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681139d0 con 0x7fbd68108420 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.853+0000 7fbd70305640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68113cd0 con 0x7fbd68102ae0 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53514/0 (socket says 172.21.15.16:53514) 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/615640453 learned_addr learned my addr 172.21.15.16:0/615640453 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68102ae0 0x7fbd6819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/615640453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68102ae0 msgr2=0x7fbd6819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68102ae0 0x7fbd6819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/615640453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd68108420 msgr2=0x7fbd6819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd68108420 0x7fbd6819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/615640453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd681a2750 con 0x7fbd68108d70 2024-09-21T00:47:50.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000eb10 tx=0x7fbd6000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd5f7fe640 1 -- 172.21.15.16:0/615640453 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60004b20 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.854+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681a2a40 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.855+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a91a0 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.855+0000 7fbd5f7fe640 1 -- 172.21.15.16:0/615640453 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd60004cc0 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.855+0000 7fbd5f7fe640 1 -- 172.21.15.16:0/615640453 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60010690 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.857+0000 7fbd76879740 1 Processor -- start 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd5f7fe640 1 -- 172.21.15.16:0/615640453 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbd60005020 con 0x7fbd68108d70 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 -- start start 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 0x55da18580be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da18581120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55da184f6ea0 con 0x55da181b8390 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55da184e62d0 con 0x55da181b01b0 2024-09-21T00:47:50.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd76879740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da184ea0e0 con 0x55da181d9070 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd6d8a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd6e0a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 0x55da18580be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd6d8a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:48144/0 (socket says 172.21.15.16:48144) 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd6d8a0640 1 -- 172.21.15.16:0/1416137548 learned_addr learned my addr 172.21.15.16:0/1416137548 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.858+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da18581120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/1416137548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 msgr2=0x55da185806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/1416137548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 msgr2=0x55da18581120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da18581120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/1416137548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da18244650 con 0x55da181b01b0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd5f7fe640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 0x7fbd540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 0x55da18580be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009c20 tx=0x7fbd64011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e43bfbf1ab47248e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 0x7fbd540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd5f7fe640 1 -- 172.21.15.16:0/615640453 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd600e7600 con 0x7fbd68108d70 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd5cd9a640 1 -- 172.21.15.16:0/1416137548 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64009dd0 con 0x55da181b01b0 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd5cd9a640 1 -- 172.21.15.16:0/1416137548 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd64005020 con 0x55da181b01b0 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.859+0000 7fbd5cd9a640 1 -- 172.21.15.16:0/1416137548 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64004a00 con 0x55da181b01b0 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 -- 172.21.15.16:0/1416137548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 msgr2=0x55da18580be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 0x7fbd540b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbd5802a930 tx=0x7fbd58031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 0x55da18580be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009c20 tx=0x7fbd64011810 comp rx=0 tx=0).stop 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 -- 172.21.15.16:0/1416137548 shutdown_connections 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da18581120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b01b0 0x55da18580be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 --2- 172.21.15.16:0/1416137548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da185806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 -- 172.21.15.16:0/1416137548 >> 172.21.15.16:0/1416137548 conn(0x55da181cd460 msgr2=0x55da1857e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 -- 172.21.15.16:0/1416137548 shutdown_connections 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.860+0000 7fbd76879740 1 -- 172.21.15.16:0/1416137548 wait complete. 2024-09-21T00:47:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 -- start start 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 Processor -- start 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da1858c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55da18347700 con 0x55da181b01b0 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55da18481160 con 0x55da181b8390 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da1858ee80 con 0x55da181d9070 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd6e0a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd6e0a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53532/0 (socket says 172.21.15.16:53532) 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd76879740 10 client.0 _ll_register_callbacks cb 0x55da1849a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/3688976811 learned_addr learned my addr 172.21.15.16:0/3688976811 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.861+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da1858c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 msgr2=0x55da1858c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da1858c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/3688976811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 msgr2=0x55da1858c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 -- 172.21.15.16:0/3688976811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da184aec90 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbd640045c0 tx=0x7fbd640098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413086fead1c8a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64029020 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd64005020 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd64004950 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd64034050 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd76879740 10 client.15816 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.862+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da1859aac0 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd64005020 con 0x55da181b01b0 2024-09-21T00:47:50.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd64025c30 con 0x55da181b01b0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 10 client.15816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 20 client.15816 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da181979f0 0x55da1859dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 4 client.15816 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da184f8df0 con 0x55da181979f0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.863+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da181979f0 0x55da1859dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.864+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da181979f0 0x55da1859dee0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c86dd7d72536c73a server_cookie=268a50316b052da4 in_seq=0 out_seq=0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.864+0000 7fbd51ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.864+0000 7fbd51ffb640 1 -- 172.21.15.16:0/3688976811 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da184f8df0 con 0x55da181979f0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.864+0000 7fbd51ffb640 10 client.15816 handle_command_reply: tid=0 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.864+0000 7fbd76879740 1 client.15816 shutdown 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 msgr2=0x55da1858bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbd640045c0 tx=0x7fbd640098d0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 shutdown_connections 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181d9070 0x55da1858c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da181979f0 0x55da1859dee0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 --2- 172.21.15.16:0/3688976811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b01b0 0x55da1858bce0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 >> 172.21.15.16:0/3688976811 conn(0x55da181cd460 msgr2=0x55da18583830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd51ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 shutdown_connections 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 1 -- 172.21.15.16:0/3688976811 wait complete. 2024-09-21T00:47:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.865+0000 7fbd76879740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T00:47:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.881+0000 7fbd76879740 1 Processor -- start 2024-09-21T00:47:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.881+0000 7fbd76879740 1 -- start start 2024-09-21T00:47:50.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185821a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 0x55da18598100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00e320 con 0x55da181b8390 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00fe60 con 0x55da181d9070 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd76879740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00e9f0 con 0x55da181b01b0 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd6d8a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd6d8a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53544/0 (socket says 172.21.15.16:53544) 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd6d8a0640 1 -- 172.21.15.16:0/1719744893 learned_addr learned my addr 172.21.15.16:0/1719744893 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.882+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 0x55da18598100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 -- 172.21.15.16:0/1719744893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 msgr2=0x55da185821a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185821a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 -- 172.21.15.16:0/1719744893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 msgr2=0x55da18598100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 0x55da18598100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 -- 172.21.15.16:0/1719744893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da1857e780 con 0x55da181b8390 2024-09-21T00:47:50.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 0x55da18598100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:50.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009230 tx=0x7fbd58009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16f597464f98e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd53fff640 1 -- 172.21.15.16:0/1719744893 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58035040 con 0x55da181b8390 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd53fff640 1 -- 172.21.15.16:0/1719744893 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd58056070 con 0x55da181b8390 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.883+0000 7fbd53fff640 1 -- 172.21.15.16:0/1719744893 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5804a440 con 0x55da181b8390 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 -- 172.21.15.16:0/1719744893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 msgr2=0x55da1858dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009230 tx=0x7fbd58009260 comp rx=0 tx=0).stop 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 -- 172.21.15.16:0/1719744893 shutdown_connections 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181d9070 0x55da18598100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181b8390 0x55da1858dbc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 --2- 172.21.15.16:0/1719744893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185821a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 -- 172.21.15.16:0/1719744893 >> 172.21.15.16:0/1719744893 conn(0x55da181cd460 msgr2=0x55da1858ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.884+0000 7fbd76879740 1 -- 172.21.15.16:0/1719744893 shutdown_connections 2024-09-21T00:47:50.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 -- 172.21.15.16:0/1719744893 wait complete. 2024-09-21T00:47:50.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 -- start start 2024-09-21T00:47:50.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 Processor -- start 2024-09-21T00:47:50.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00f790 con 0x55da181d9070 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00f0c0 con 0x55da181b8390 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.885+0000 7fbd76879740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c00c300 con 0x55da181b01b0 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd76879740 10 client.0 _ll_register_callbacks cb 0x7fbd600093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e0a1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53548/0 (socket says 172.21.15.16:53548) 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/360949149 learned_addr learned my addr 172.21.15.16:0/360949149 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:50.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 msgr2=0x55da185947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/360949149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 msgr2=0x55da1858fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 -- 172.21.15.16:0/360949149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da185907f0 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6d8a0640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd6e8a2640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009270 tx=0x7fbd600b70f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b58dba4601508c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd600ad170 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fbd600a9170 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.886+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd58056070 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd600acf90 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da18608630 con 0x55da181d9070 2024-09-21T00:47:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd58056070 con 0x55da181d9070 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd600a9370 con 0x55da181d9070 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 10 client.15822 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 20 client.15822 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da1816cda0 0x55da1860ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 4 client.15822 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 --> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da184f48a0 con 0x55da1816cda0 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.887+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da1816cda0 0x55da1860ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd51ffb640 10 client.15822 ms_handle_connect on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd6e0a1640 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da1816cda0 0x55da1860ad50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c72900988d2b925c server_cookie=7a5872baa048a0cc in_seq=0 out_seq=0 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd51ffb640 1 -- 172.21.15.16:0/360949149 <== mds.2 v2:172.21.15.178:6838/3738575776 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da184f48a0 con 0x55da1816cda0 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd51ffb640 10 client.15822 handle_command_reply: tid=0 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 client.15822 shutdown 2024-09-21T00:47:50.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 msgr2=0x55da185901b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009270 tx=0x7fbd600b70f0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 shutdown_connections 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:6838/3738575776,v1:172.21.15.178:6839/3738575776] conn(0x55da1816cda0 0x55da1860ad50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55da181d9070 0x55da185901b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da181b8390 0x55da1858fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 --2- 172.21.15.16:0/360949149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da181b01b0 0x55da185947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd51ffb640 0 client.15822 ms_handle_reset on v2:172.21.15.178:6838/3738575776 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.888+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 >> 172.21.15.16:0/360949149 conn(0x55da181cd460 msgr2=0x55da1858ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 shutdown_connections 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd76879740 1 -- 172.21.15.16:0/360949149 wait complete. 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd76879740 20 client.15822 trim_cache size 0 max 16384 2024-09-21T00:47:50.894 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 msgr2=0x7fbd540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 0x7fbd540b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbd5802a930 tx=0x7fbd58031400 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 msgr2=0x7fbd681a2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000eb10 tx=0x7fbd6000c2d0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 shutdown_connections 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbd540b6510 0x7fbd540b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd68108d70 0x7fbd681a2020 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.889+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd68108420 0x7fbd6819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.890+0000 7fbd70305640 1 --2- 172.21.15.16:0/615640453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd68102ae0 0x7fbd6819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:50.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.890+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 >> 172.21.15.16:0/615640453 conn(0x7fbd68079770 msgr2=0x7fbd681063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.890+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 shutdown_connections 2024-09-21T00:47:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:50.890+0000 7fbd70305640 1 -- 172.21.15.16:0/615640453 wait complete. 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T00:47:51.250 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:51.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T00:47:51.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:51.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T00:47:51.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:51.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:51.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:51 smithi016 ceph-mon[30947]: pgmap v397: 97 pgs: 97 active+clean; 303 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 1.4 MiB/s wr, 1.04k op/s 2024-09-21T00:47:51.553 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:51.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T00:47:51.558 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:51.559 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:51.560 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:51.561 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:51.562 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T00:47:51.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:51 smithi123 ceph-mon[34853]: pgmap v397: 97 pgs: 97 active+clean; 303 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 1.4 MiB/s wr, 1.04k op/s 2024-09-21T00:47:51.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:51 smithi178 ceph-mon[34888]: pgmap v397: 97 pgs: 97 active+clean; 303 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 1.4 MiB/s wr, 1.04k op/s 2024-09-21T00:47:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:51.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:51.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T00:47:51.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:51.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:51.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:51.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 -- 172.21.15.16:0/1523643389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc1028a0 msgr2=0x7fc6dc102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/1523643389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc102cb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009900 tx=0x7fc6cc02a410 comp rx=0 tx=0).stop 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 -- 172.21.15.16:0/1523643389 shutdown_connections 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/1523643389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc108b30 0x7fc6dc10f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/1523643389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/1523643389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc102cb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 -- 172.21.15.16:0/1523643389 >> 172.21.15.16:0/1523643389 conn(0x7fc6dc0fe2f0 msgr2=0x7fc6dc100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 -- 172.21.15.16:0/1523643389 shutdown_connections 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.338+0000 7fc6e19eb640 1 -- 172.21.15.16:0/1523643389 wait complete. 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.339+0000 7fc6e19eb640 1 Processor -- start 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.339+0000 7fc6e19eb640 1 -- start start 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 0x7fc6dc19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1127f0 con 0x7fc6dc108b30 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112670 con 0x7fc6dc1028a0 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6e19eb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112970 con 0x7fc6dc1081e0 2024-09-21T00:47:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 0x7fc6dc19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:33232/0 (socket says 172.21.15.16:33232) 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 -- 172.21.15.16:0/2742772216 learned_addr learned my addr 172.21.15.16:0/2742772216 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 -- 172.21.15.16:0/2742772216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 msgr2=0x7fc6dc19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 -- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 msgr2=0x7fc6dc19bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 0x7fc6dc19bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6daffd640 1 -- 172.21.15.16:0/2742772216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc1a63f0 con 0x7fc6dc1028a0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 0x7fc6dc19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.340+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6daffd640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005940 tx=0x7fc6cc0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6e09e9640 1 -- 172.21.15.16:0/2742772216 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc03f030 con 0x7fc6dc1028a0 2024-09-21T00:47:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc1a6680 con 0x7fc6dc1028a0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6e09e9640 1 -- 172.21.15.16:0/2742772216 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6cc0044c0 con 0x7fc6dc1028a0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6e09e9640 1 -- 172.21.15.16:0/2742772216 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc035070 con 0x7fc6dc1028a0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.341+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1a6b60 con 0x7fc6dc1028a0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.343+0000 7fc6e7f5f740 1 Processor -- start 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.343+0000 7fc6e7f5f740 1 -- start start 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e09e9640 1 -- 172.21.15.16:0/2742772216 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc6cc042030 con 0x7fc6dc1028a0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1891b0 0x55e61e559da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e55a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e61e4cfea0 con 0x55e61e191390 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e61e4bf2d0 con 0x55e61e1b2070 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e61e4c30e0 con 0x55e61e1891b0 2024-09-21T00:47:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6da7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e55a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6daffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1891b0 0x55e61e559da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.16:33236/0 (socket says 172.21.15.16:33236) 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 -- 172.21.15.16:0/1735263611 learned_addr learned my addr 172.21.15.16:0/1735263611 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 -- 172.21.15.16:0/1735263611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1891b0 msgr2=0x55e61e559da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1891b0 0x55e61e559da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 -- 172.21.15.16:0/1735263611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 msgr2=0x55e61e55a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e55a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6db7fe640 1 -- 172.21.15.16:0/1735263611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e61e21d650 con 0x55e61e1b2070 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.344+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e55a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40117a0 tx=0x7fc6d4011c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf05378be2f18399 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6e09e9640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 0x7fc6c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6c1ffb640 1 -- 172.21.15.16:0/1735263611 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4011220 con 0x55e61e1b2070 2024-09-21T00:47:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6daffd640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 0x7fc6c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6c1ffb640 1 -- 172.21.15.16:0/1735263611 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d400fa60 con 0x55e61e1b2070 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6c1ffb640 1 -- 172.21.15.16:0/1735263611 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40056a0 con 0x55e61e1b2070 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.345+0000 7fc6e09e9640 1 -- 172.21.15.16:0/2742772216 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6cc1075f0 con 0x7fc6dc1028a0 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6daffd640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 0x7fc6c40b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c9e90 tx=0x7fc6cc10d530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1735263611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 msgr2=0x55e61e559860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40117a0 tx=0x7fc6d4011c60 comp rx=0 tx=0).stop 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1735263611 shutdown_connections 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e55a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1891b0 0x55e61e559da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1735263611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e559860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1735263611 >> 172.21.15.16:0/1735263611 conn(0x55e61e1a6460 msgr2=0x55e61e557750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1735263611 shutdown_connections 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.348+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1735263611 wait complete. 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.349+0000 7fc6e7f5f740 1 -- start start 2024-09-21T00:47:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.349+0000 7fc6e7f5f740 1 Processor -- start 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.349+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e564f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e571330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e61e320700 con 0x55e61e191390 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e61e45a160 con 0x55e61e1891b0 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e61e568040 con 0x55e61e1b2070 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 10 client.0 _ll_register_callbacks cb 0x55e61e4739e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53582/0 (socket says 172.21.15.16:53582) 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e564f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 -- 172.21.15.16:0/1178736546 learned_addr learned my addr 172.21.15.16:0/1178736546 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:52.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e571330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 -- 172.21.15.16:0/1178736546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 msgr2=0x55e61e571330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e571330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 -- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 msgr2=0x55e61e564f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e564f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 -- 172.21.15.16:0/1178736546 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e61e487c90 con 0x55e61e191390 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0012d20 tx=0x7fc6d000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9975fc3fbe6ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6baffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00120d0 con 0x55e61e191390 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6d0004030 con 0x55e61e191390 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.350+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d400fa60 con 0x55e61e191390 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6d0012270 con 0x55e61e191390 2024-09-21T00:47:52.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 10 client.15834 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e61e573e10 con 0x55e61e191390 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d400fa60 con 0x55e61e191390 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6d001c460 con 0x55e61e191390 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 10 client.15834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 20 client.15834 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e1709f0 0x55e61e577360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 4 client.15834 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e61e4d1df0 con 0x55e61e1709f0 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.351+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e1709f0 0x55e61e577360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.352+0000 7fc6baffd640 10 client.15834 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.352+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e1709f0 0x55e61e577360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=249767648dacf962 server_cookie=e42669959b25c1e0 in_seq=0 out_seq=0 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6baffd640 1 -- 172.21.15.16:0/1178736546 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e61e4d1df0 con 0x55e61e1709f0 2024-09-21T00:47:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6baffd640 10 client.15834 handle_command_reply: tid=0 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 client.15834 shutdown 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 msgr2=0x55e61e565470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0012d20 tx=0x7fc6d000f790 comp rx=0 tx=0).stop 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 shutdown_connections 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e1709f0 0x55e61e577360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e571330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e191390 0x55e61e565470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/1178736546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e564f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 >> 172.21.15.16:0/1178736546 conn(0x55e61e1a6460 msgr2=0x55e61e55ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6baffd640 0 client.15834 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 shutdown_connections 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/1178736546 wait complete. 2024-09-21T00:47:52.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.353+0000 7fc6e7f5f740 20 client.15834 trim_cache size 0 max 16384 2024-09-21T00:47:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 Processor -- start 2024-09-21T00:47:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 -- start start 2024-09-21T00:47:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e571230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e145da0 0x55e61e562120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1af010 con 0x55e61e1891b0 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1b0b50 con 0x55e61e1b2070 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1af6e0 con 0x55e61e145da0 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53592/0 (socket says 172.21.15.16:53592) 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.367+0000 7fc6db7fe640 1 -- 172.21.15.16:0/96456586 learned_addr learned my addr 172.21.15.16:0/96456586 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e145da0 0x55e61e562120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 -- 172.21.15.16:0/96456586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e145da0 msgr2=0x55e61e562120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e145da0 0x55e61e562120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 -- 172.21.15.16:0/96456586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 msgr2=0x55e61e571230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e571230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 -- 172.21.15.16:0/96456586 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e61e565fd0 con 0x55e61e1891b0 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.368+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009730 tx=0x7fc6d4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cf70767e84e7de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.369+0000 7fc6c17fa640 1 -- 172.21.15.16:0/96456586 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d401d040 con 0x55e61e1891b0 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.369+0000 7fc6c17fa640 1 -- 172.21.15.16:0/96456586 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d4005130 con 0x55e61e1891b0 2024-09-21T00:47:52.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.369+0000 7fc6c17fa640 1 -- 172.21.15.16:0/96456586 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4005590 con 0x55e61e1891b0 2024-09-21T00:47:52.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/96456586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 msgr2=0x55e61e557780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009730 tx=0x7fc6d4009500 comp rx=0 tx=0).stop 2024-09-21T00:47:52.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/96456586 shutdown_connections 2024-09-21T00:47:52.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e145da0 0x55e61e562120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1b2070 0x55e61e571230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/96456586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e1891b0 0x55e61e557780 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/96456586 >> 172.21.15.16:0/96456586 conn(0x55e61e1a6460 msgr2=0x55e61e557070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/96456586 shutdown_connections 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/96456586 wait complete. 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.370+0000 7fc6e7f5f740 1 -- start start 2024-09-21T00:47:52.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 Processor -- start 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e569ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e5e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1b0480 con 0x55e61e145da0 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1afdb0 con 0x55e61e1891b0 2024-09-21T00:47:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1ad030 con 0x55e61e1b2070 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6e7f5f740 10 client.0 _ll_register_callbacks cb 0x7fc6d0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53596/0 (socket says 172.21.15.16:53596) 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6db7fe640 1 -- 172.21.15.16:0/4170230786 learned_addr learned my addr 172.21.15.16:0/4170230786 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e569ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.371+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e5e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 -- 172.21.15.16:0/4170230786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 msgr2=0x55e61e5e0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e5e0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 -- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 msgr2=0x55e61e569ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e569ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 -- 172.21.15.16:0/4170230786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e61e56a3b0 con 0x55e61e145da0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6db7fe640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc6d402a040 tx=0x7fc6d4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5fb43cb6e612e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6baffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d401d050 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fc6d4005390 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d4005130 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6d4005590 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6e7f5f740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.372+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e61e5e22e0 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d4005130 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6d4040020 con 0x55e61e145da0 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 10 client.15840 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 20 client.15840 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e5e2700 0x55e61e5e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 4 client.15840 mds_command: new command op to 24644 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 --> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e61e4cd8a0 con 0x55e61e5e2700 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.373+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e5e2700 0x55e61e5e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6da7fc640 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e5e2700 0x55e61e5e4b20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab95f75456ec791f server_cookie=7db4da966223fc31 in_seq=0 out_seq=0 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6baffd640 10 client.15840 ms_handle_connect on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6baffd640 1 -- 172.21.15.16:0/4170230786 <== mds.1 v2:172.21.15.123:6836/2648060982 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e61e4cd8a0 con 0x55e61e5e2700 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6baffd640 10 client.15840 handle_command_reply: tid=0 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 client.15840 shutdown 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 msgr2=0x55e61e5695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc6d402a040 tx=0x7fc6d4005bd0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 shutdown_connections 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:6836/2648060982,v1:172.21.15.123:6837/2648060982] conn(0x55e61e5e2700 0x55e61e5e4b20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e61e1b2070 0x55e61e5e0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e61e1891b0 0x55e61e569ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 --2- 172.21.15.16:0/4170230786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e61e145da0 0x55e61e5695a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 >> 172.21.15.16:0/4170230786 conn(0x55e61e1a6460 msgr2=0x55e61e5637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6baffd640 0 client.15840 ms_handle_reset on v2:172.21.15.123:6836/2648060982 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 shutdown_connections 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 1 -- 172.21.15.16:0/4170230786 wait complete. 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.374+0000 7fc6e7f5f740 20 client.15840 trim_cache size 0 max 16384 2024-09-21T00:47:52.380 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 msgr2=0x7fc6c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 0x7fc6c40b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0c9e90 tx=0x7fc6cc10d530 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 msgr2=0x7fc6dc19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005940 tx=0x7fc6cc0040c0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 shutdown_connections 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc6c40b6510 0x7fc6c40b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6dc108b30 0x7fc6dc19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc1081e0 0x7fc6dc19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 --2- 172.21.15.16:0/2742772216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6dc1028a0 0x7fc6dc19b0e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 >> 172.21.15.16:0/2742772216 conn(0x7fc6dc0fe2f0 msgr2=0x7fc6dc100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 shutdown_connections 2024-09-21T00:47:52.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:52.375+0000 7fc6e19eb640 1 -- 172.21.15.16:0/2742772216 wait complete. 2024-09-21T00:47:52.482 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:52.482 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:52.483 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T00:47:52.484 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:52.485 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T00:47:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:52.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T00:47:52.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:52.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:52.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:52.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:53.251 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T00:47:53.252 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:53.253 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:53.255 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:53.256 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:53.461 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:53 smithi016 ceph-mon[30947]: pgmap v398: 97 pgs: 97 active+clean; 355 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 1.6 MiB/s wr, 1.12k op/s 2024-09-21T00:47:53.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T00:47:53.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:53.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:53.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T00:47:53.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T00:47:53.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:53.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T00:47:53.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:53 smithi123 ceph-mon[34853]: pgmap v398: 97 pgs: 97 active+clean; 355 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 1.6 MiB/s wr, 1.12k op/s 2024-09-21T00:47:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:53.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:53 smithi178 ceph-mon[34888]: pgmap v398: 97 pgs: 97 active+clean; 355 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 1.6 MiB/s wr, 1.12k op/s 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:54.225 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T00:47:54.226 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:54.227 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:54.228 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:54.229 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:54.230 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T00:47:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 -- 172.21.15.16:0/544286801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 msgr2=0x7feef0102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 --2- 172.21.15.16:0/544286801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef0102ed0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7feee0009900 tx=0x7feee002a410 comp rx=0 tx=0).stop 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 -- 172.21.15.16:0/544286801 shutdown_connections 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 --2- 172.21.15.16:0/544286801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef0108d00 0x7feef010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 --2- 172.21.15.16:0/544286801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef01083b0 0x7feef01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 --2- 172.21.15.16:0/544286801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef0102ed0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.241+0000 7feef5677640 1 -- 172.21.15.16:0/544286801 >> 172.21.15.16:0/544286801 conn(0x7feef0079720 msgr2=0x7feef0079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.242+0000 7feef5677640 1 -- 172.21.15.16:0/544286801 shutdown_connections 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.242+0000 7feef5677640 1 -- 172.21.15.16:0/544286801 wait complete. 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.242+0000 7feef5677640 1 Processor -- start 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.242+0000 7feef5677640 1 -- start start 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 0x7feef019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 0x7feef019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113ae0 con 0x7feef0102ac0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113960 con 0x7feef0108d00 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feef5677640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113c60 con 0x7feef01083b0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 0x7feef019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 0x7feef019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39492/0 (socket says 172.21.15.16:39492) 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeeeffd640 1 -- 172.21.15.16:0/2271252638 learned_addr learned my addr 172.21.15.16:0/2271252638 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 -- 172.21.15.16:0/2271252638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 msgr2=0x7feef019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 0x7feef019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 -- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 msgr2=0x7feef019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeee7fc640 1 -- 172.21.15.16:0/2271252638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef01a0420 con 0x7feef01083b0 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.243+0000 7feeef7fe640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 0x7feef019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:54.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feeee7fc640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 0x7feef019aa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feee4005fd0 tx=0x7feee400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feed7fff640 1 -- 172.21.15.16:0/2271252638 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4009c00 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feed7fff640 1 -- 172.21.15.16:0/2271252638 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee4009da0 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feed7fff640 1 -- 172.21.15.16:0/2271252638 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4003e10 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef01a0710 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.244+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef010fef0 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feed7fff640 1 -- 172.21.15.16:0/2271252638 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7feee4010460 con 0x7feef01083b0 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 Processor -- start 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 -- start start 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e57be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e58120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563c6dcdea0 con 0x5563c6a8f390 2024-09-21T00:47:54.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563c6dbd2d0 con 0x5563c6ab0070 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.247+0000 7feefbbeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5563c6dc10e0 con 0x5563c6a871b0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feed7fff640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 0x7feed80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e57be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e57be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:35572/0 (socket says 172.21.15.16:35572) 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeeeffd640 1 -- 172.21.15.16:0/548013671 learned_addr learned my addr 172.21.15.16:0/548013671 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 0x7feed80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feed7fff640 1 -- 172.21.15.16:0/2271252638 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7feee40e6dd0 con 0x7feef01083b0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 -- 172.21.15.16:0/548013671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 msgr2=0x5563c6e57be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e57be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 -- 172.21.15.16:0/548013671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 msgr2=0x5563c6e58120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeee7fc640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e58120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e58120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 -- 172.21.15.16:0/548013671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c6b1b650 con 0x5563c6ab0070 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeee7fc640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e58120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.248+0000 7feeef7fe640 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e576a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feee8012d00 tx=0x7feee8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0b7dc79ab17e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.249+0000 7feed57fa640 1 -- 172.21.15.16:0/548013671 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee801d600 con 0x5563c6ab0070 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.249+0000 7feed57fa640 1 -- 172.21.15.16:0/548013671 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee8022070 con 0x5563c6ab0070 2024-09-21T00:47:54.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.249+0000 7feed57fa640 1 -- 172.21.15.16:0/548013671 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee801c9e0 con 0x5563c6ab0070 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 -- 172.21.15.16:0/548013671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 msgr2=0x5563c6e576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feeef7fe640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 0x7feed80b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee8021000 tx=0x7feee800e720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e576a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feee8012d00 tx=0x7feee8010740 comp rx=0 tx=0).stop 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 -- 172.21.15.16:0/548013671 shutdown_connections 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e58120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e57be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 --2- 172.21.15.16:0/548013671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e576a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 -- 172.21.15.16:0/548013671 >> 172.21.15.16:0/548013671 conn(0x5563c6aa4460 msgr2=0x5563c6e55590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 -- 172.21.15.16:0/548013671 shutdown_connections 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.250+0000 7feefbbeb740 1 -- 172.21.15.16:0/548013671 wait complete. 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 -- start start 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 Processor -- start 2024-09-21T00:47:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a8f390 0x5563c6e632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e6f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563c6c1e700 con 0x5563c6a871b0 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563c6d58160 con 0x5563c6ab0070 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5563c6e65e80 con 0x5563c6a8f390 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feefbbeb740 10 client.0 _ll_register_callbacks cb 0x5563c6d719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.251+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39504/0 (socket says 172.21.15.16:39504) 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 -- 172.21.15.16:0/1857065323 learned_addr learned my addr 172.21.15.16:0/1857065323 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeee7fc640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a8f390 0x5563c6e632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeef7fe640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e6f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 -- 172.21.15.16:0/1857065323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a8f390 msgr2=0x5563c6e632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a8f390 0x5563c6e632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 -- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 msgr2=0x5563c6e6f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e6f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 -- 172.21.15.16:0/1857065323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c6d85c90 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeef7fe640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e6f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feeeeffd640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feee0005940 tx=0x7feee00314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50313ddc611d392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.252+0000 7feed2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0035040 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feee8022070 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7feee0004040 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feee0004240 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feefbbeb740 10 client.15849 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563c6e71b10 con 0x5563c6a871b0 2024-09-21T00:47:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee8022070 con 0x5563c6a871b0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feee004f050 con 0x5563c6a871b0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.253+0000 7feefbbeb740 10 client.15849 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feefbbeb740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feefbbeb740 20 client.15849 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a6e9f0 0x5563c6e75000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feefbbeb740 4 client.15849 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563c6dcfdf0 con 0x5563c6a6e9f0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feeee7fc640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a6e9f0 0x5563c6e75000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feeee7fc640 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a6e9f0 0x5563c6e75000 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f347c77e103fa0 server_cookie=e10cffe634b86377 in_seq=0 out_seq=0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.254+0000 7feed2ff5640 10 client.15849 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feed2ff5640 1 -- 172.21.15.16:0/1857065323 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563c6dcfdf0 con 0x5563c6a6e9f0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feed2ff5640 10 client.15849 handle_command_reply: tid=0 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 client.15849 shutdown 2024-09-21T00:47:54.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 msgr2=0x5563c6e62d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feee0005940 tx=0x7feee00314a0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 shutdown_connections 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a6e9f0 0x5563c6e75000 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e6f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a8f390 0x5563c6e632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 --2- 172.21.15.16:0/1857065323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e62d70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 >> 172.21.15.16:0/1857065323 conn(0x5563c6aa4460 msgr2=0x5563c6e5a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feed2ff5640 0 client.15849 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 shutdown_connections 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 1 -- 172.21.15.16:0/1857065323 wait complete. 2024-09-21T00:47:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.256+0000 7feefbbeb740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T00:47:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 Processor -- start 2024-09-21T00:47:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 -- start start 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e64c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e58de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feef01b1410 con 0x5563c6a8f390 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feef01b2f50 con 0x5563c6ab0070 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.271+0000 7feefbbeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feef01b1ae0 con 0x5563c6a871b0 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeee7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e64c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e58de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:35584/0 (socket says 172.21.15.16:35584) 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeee7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e64c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39518/0 (socket says 172.21.15.16:39518) 2024-09-21T00:47:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 -- 172.21.15.16:0/3078205638 learned_addr learned my addr 172.21.15.16:0/3078205638 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 -- 172.21.15.16:0/3078205638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 msgr2=0x5563c6e58de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e58de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 -- 172.21.15.16:0/3078205638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 msgr2=0x5563c6e64c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e64c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 -- 172.21.15.16:0/3078205638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c6e55e80 con 0x5563c6a871b0 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.272+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4790f28bdfd282 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.273+0000 7feed4ff9640 1 -- 172.21.15.16:0/3078205638 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0055030 con 0x5563c6a871b0 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.273+0000 7feed4ff9640 1 -- 172.21.15.16:0/3078205638 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee00043e0 con 0x5563c6a871b0 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.273+0000 7feed4ff9640 1 -- 172.21.15.16:0/3078205638 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0035030 con 0x5563c6a871b0 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- 172.21.15.16:0/3078205638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 msgr2=0x5563c6e632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee0031400 comp rx=0 tx=0).stop 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- 172.21.15.16:0/3078205638 shutdown_connections 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6ab0070 0x5563c6e58de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a8f390 0x5563c6e64c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3078205638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6a871b0 0x5563c6e632f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- 172.21.15.16:0/3078205638 >> 172.21.15.16:0/3078205638 conn(0x5563c6aa4460 msgr2=0x5563c6e586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- 172.21.15.16:0/3078205638 shutdown_connections 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- 172.21.15.16:0/3078205638 wait complete. 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 -- start start 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.274+0000 7feefbbeb740 1 Processor -- start 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 0x5563c6e67530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6ab0070 0x5563c6e67a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feef01b2880 con 0x5563c6a871b0 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feef01b21b0 con 0x5563c6a8f390 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feef01af410 con 0x5563c6ab0070 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feefbbeb740 10 client.0 _ll_register_callbacks cb 0x7feee0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39532/0 (socket says 172.21.15.16:39532) 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 -- 172.21.15.16:0/3327478644 learned_addr learned my addr 172.21.15.16:0/3327478644 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeee7fc640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 0x5563c6e67530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 -- 172.21.15.16:0/3327478644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6ab0070 msgr2=0x5563c6e67a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6ab0070 0x5563c6e67a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 -- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 msgr2=0x5563c6e67530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 0x5563c6e67530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeeeffd640 1 -- 172.21.15.16:0/3327478644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c6ede9c0 con 0x5563c6a871b0 2024-09-21T00:47:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.275+0000 7feeee7fc640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 0x5563c6e67530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feeeeffd640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7feee002a450 tx=0x7feee0031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6699bff655df0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0055040 con 0x5563c6a871b0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7feee003d9e0 con 0x5563c6a871b0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feee00043e0 con 0x5563c6a871b0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feee003d810 con 0x5563c6a871b0 2024-09-21T00:47:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feefbbeb740 10 client.15855 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563c6edfb80 con 0x5563c6a871b0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feee00043e0 con 0x5563c6a871b0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feee004f040 con 0x5563c6a871b0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feefbbeb740 10 client.15855 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.276+0000 7feefbbeb740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feefbbeb740 20 client.15855 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a43da0 0x5563c6ee2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feefbbeb740 4 client.15855 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563c6dcb8a0 con 0x5563c6a43da0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feeee7fc640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a43da0 0x5563c6ee2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feeee7fc640 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a43da0 0x5563c6ee2140 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75aa6ad337eedc94 server_cookie=6b5c590b4a44148c in_seq=0 out_seq=0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feed2ff5640 10 client.15855 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feed2ff5640 1 -- 172.21.15.16:0/3327478644 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563c6dcb8a0 con 0x5563c6a43da0 2024-09-21T00:47:54.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feed2ff5640 10 client.15855 handle_command_reply: tid=0 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.277+0000 7feefbbeb740 1 client.15855 shutdown 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 msgr2=0x5563c6e66ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7feee002a450 tx=0x7feee0031a80 comp rx=0 tx=0).stop 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 shutdown_connections 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x5563c6a43da0 0x5563c6ee2140 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563c6ab0070 0x5563c6e67a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563c6a8f390 0x5563c6e67530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feed2ff5640 0 client.15855 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 --2- 172.21.15.16:0/3327478644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563c6a871b0 0x5563c6e66ff0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 >> 172.21.15.16:0/3327478644 conn(0x5563c6aa4460 msgr2=0x5563c6e64ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 shutdown_connections 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 1 -- 172.21.15.16:0/3327478644 wait complete. 2024-09-21T00:47:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feefbbeb740 20 client.15855 trim_cache size 0 max 16384 2024-09-21T00:47:54.283 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-21T00:47:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 msgr2=0x7feed80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 0x7feed80b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee8021000 tx=0x7feee800e720 comp rx=0 tx=0).stop 2024-09-21T00:47:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 msgr2=0x7feef019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.278+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 0x7feef019aa50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feee4005fd0 tx=0x7feee400dde0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 shutdown_connections 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7feed80b6510 0x7feed80b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feef0108d00 0x7feef019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef01083b0 0x7feef019aa50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 --2- 172.21.15.16:0/2271252638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feef0102ac0 0x7feef019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 >> 172.21.15.16:0/2271252638 conn(0x7feef0079720 msgr2=0x7feef01064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 shutdown_connections 2024-09-21T00:47:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:54.279+0000 7feef5677640 1 -- 172.21.15.16:0/2271252638 wait complete. 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:54.572 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:54.573 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:54.574 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:54.575 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:54.576 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T00:47:54.577 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:54.954 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:54.955 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:54.956 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T00:47:54.957 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:54.958 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:54.959 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:54.960 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:55.015 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:55.015 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T00:47:55.015 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:55.015 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T00:47:55.016 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:47:55.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:47:55.048 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-21T00:47:55.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 -- 172.21.15.16:0/1364628781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c1025a0 msgr2=0x7f397c102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 --2- 172.21.15.16:0/1364628781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c1025a0 0x7f397c102a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f396c009900 tx=0x7f396c02a410 comp rx=0 tx=0).stop 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 -- 172.21.15.16:0/1364628781 shutdown_connections 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 --2- 172.21.15.16:0/1364628781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 0x7f397c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 --2- 172.21.15.16:0/1364628781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c103620 0x7f397c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 --2- 172.21.15.16:0/1364628781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c1025a0 0x7f397c102a10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 -- 172.21.15.16:0/1364628781 >> 172.21.15.16:0/1364628781 conn(0x7f397c0fdee0 msgr2=0x7f397c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 -- 172.21.15.16:0/1364628781 shutdown_connections 2024-09-21T00:47:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 -- 172.21.15.16:0/1364628781 wait complete. 2024-09-21T00:47:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.138+0000 7f39817b0640 1 Processor -- start 2024-09-21T00:47:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 -- start start 2024-09-21T00:47:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c1025a0 0x7f397c199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 0x7f397c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10e1f0 con 0x7f397c103620 2024-09-21T00:47:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10e070 con 0x7f397c1025a0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f39817b0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10e370 con 0x7f397c103fc0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39536/0 (socket says 172.21.15.16:39536) 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 -- 172.21.15.16:0/452020630 learned_addr learned my addr 172.21.15.16:0/452020630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397affd640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c1025a0 0x7f397c199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397b7fe640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 0x7f397c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 -- 172.21.15.16:0/452020630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 msgr2=0x7f397c19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 0x7f397c19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 -- 172.21.15.16:0/452020630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c1025a0 msgr2=0x7f397c199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c1025a0 0x7f397c199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.139+0000 7f397a7fc640 1 -- 172.21.15.16:0/452020630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c19b970 con 0x7f397c103620 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f397a7fc640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9f0 tx=0x7f397000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f3963fff640 1 -- 172.21.15.16:0/452020630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397000cd80 con 0x7f397c103620 2024-09-21T00:47:55.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f3963fff640 1 -- 172.21.15.16:0/452020630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700108e0 con 0x7f397c103620 2024-09-21T00:47:55.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c19bc60 con 0x7f397c103620 2024-09-21T00:47:55.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f3963fff640 1 -- 172.21.15.16:0/452020630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970018980 con 0x7f397c103620 2024-09-21T00:47:55.143 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.140+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c1a2350 con 0x7f397c103620 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.142+0000 7f39887f3740 1 Processor -- start 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.142+0000 7f3963fff640 1 -- 172.21.15.16:0/452020630 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3970018b20 con 0x7f397c103620 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.142+0000 7f39887f3740 1 -- start start 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 0x55b0775b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b0775216f0 con 0x55b0771de2f0 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b077510b20 con 0x55b0772071b0 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f39887f3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b077514930 con 0x55b0771e64d0 2024-09-21T00:47:55.145 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39552/0 (socket says 172.21.15.16:39552) 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 -- 172.21.15.16:0/2516703910 learned_addr learned my addr 172.21.15.16:0/2516703910 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397a7fc640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 0x55b0775b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397b7fe640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 -- 172.21.15.16:0/2516703910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 msgr2=0x55b0775b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 0x55b0775b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 -- 172.21.15.16:0/2516703910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 msgr2=0x55b0775b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397affd640 1 -- 172.21.15.16:0/2516703910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0774d6530 con 0x55b0771de2f0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397a7fc640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 0x55b0775b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f397b7fe640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.143+0000 7f3963fff640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 0x7f39640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f397b7fe640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 0x7f39640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f397affd640 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f396c02a930 tx=0x7f396c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df7efd94968643c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f3963fff640 1 -- 172.21.15.16:0/452020630 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f39700e75b0 con 0x7f397c103620 2024-09-21T00:47:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f39617fa640 1 -- 172.21.15.16:0/2516703910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c035030 con 0x55b0771de2f0 2024-09-21T00:47:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f39617fa640 1 -- 172.21.15.16:0/2516703910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f396c040070 con 0x55b0771de2f0 2024-09-21T00:47:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.144+0000 7f39617fa640 1 -- 172.21.15.16:0/2516703910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c003970 con 0x55b0771de2f0 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- 172.21.15.16:0/2516703910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 msgr2=0x55b0775b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f397b7fe640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 0x7f39640b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3974011550 tx=0x7f39740094e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f396c02a930 tx=0x7f396c009620 comp rx=0 tx=0).stop 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- 172.21.15.16:0/2516703910 shutdown_connections 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771e64d0 0x55b0775b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775b38d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 --2- 172.21.15.16:0/2516703910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- 172.21.15.16:0/2516703910 >> 172.21.15.16:0/2516703910 conn(0x55b0771fb300 msgr2=0x55b0775aa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- 172.21.15.16:0/2516703910 shutdown_connections 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- 172.21.15.16:0/2516703910 wait complete. 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 -- start start 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.145+0000 7f39887f3740 1 Processor -- start 2024-09-21T00:47:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771de2f0 0x55b0775bc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b077448ab0 con 0x55b0771e64d0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b0774b6730 con 0x55b0771de2f0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b0775b4ee0 con 0x55b0772071b0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f39887f3740 10 client.0 _ll_register_callbacks cb 0x55b07750a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39564/0 (socket says 172.21.15.16:39564) 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 -- 172.21.15.16:0/588065342 learned_addr learned my addr 172.21.15.16:0/588065342 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397affd640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771de2f0 0x55b0775bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397b7fe640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 -- 172.21.15.16:0/588065342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 msgr2=0x55b0775bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 -- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771de2f0 msgr2=0x55b0775bc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771de2f0 0x55b0775bc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 -- 172.21.15.16:0/588065342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b077272790 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f397a7fc640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f39700ad810 tx=0x7f39700e77b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2200fade587ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.146+0000 7f395eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39700a9720 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f39700e70d0 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f396c040070 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39700acff0 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 10 client.15867 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0772eb620 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f396c040070 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39700e9b70 con 0x55b0771e64d0 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 10 client.15867 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 20 client.15867 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b0771c5d80 0x55b0775ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 4 client.15867 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.147+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b077523640 con 0x55b0771c5d80 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.148+0000 7f397affd640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b0771c5d80 0x55b0775ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.148+0000 7f395eff5640 10 client.15867 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.148+0000 7f397affd640 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b0771c5d80 0x55b0775ca0c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128fd69e78677a02 server_cookie=56e2603af4af61c6 in_seq=0 out_seq=0 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f395eff5640 1 -- 172.21.15.16:0/588065342 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b077523640 con 0x55b0771c5d80 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f395eff5640 10 client.15867 handle_command_reply: tid=0 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 client.15867 shutdown 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 msgr2=0x55b0775bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f39700ad810 tx=0x7f39700e77b0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 shutdown_connections 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b0771c5d80 0x55b0775ca0c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775bd020 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f395eff5640 0 client.15867 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 --2- 172.21.15.16:0/588065342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771de2f0 0x55b0775bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 >> 172.21.15.16:0/588065342 conn(0x55b0771fb300 msgr2=0x55b0775a8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 shutdown_connections 2024-09-21T00:47:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 1 -- 172.21.15.16:0/588065342 wait complete. 2024-09-21T00:47:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.149+0000 7f39887f3740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T00:47:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 Processor -- start 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 -- start start 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 0x55b0775baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1a8c60 con 0x55b0771de2f0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1aa7a0 con 0x55b0771e64d0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f39887f3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1a9330 con 0x55b0772071b0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39566/0 (socket says 172.21.15.16:39566) 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397affd640 1 -- 172.21.15.16:0/4132628601 learned_addr learned my addr 172.21.15.16:0/4132628601 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 0x55b0775baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397b7fe640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 -- 172.21.15.16:0/4132628601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 msgr2=0x55b0775bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 -- 172.21.15.16:0/4132628601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 msgr2=0x55b0775aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397a7fc640 1 -- 172.21.15.16:0/4132628601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0775bdf00 con 0x55b0771e64d0 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.164+0000 7f397affd640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.165+0000 7f397a7fc640 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 0x55b0775baef0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39700a9e50 tx=0x7f39700b21b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eea3d186cf9e601 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.165+0000 7f3960ff9640 1 -- 172.21.15.16:0/4132628601 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39700ad1d0 con 0x55b0771e64d0 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.165+0000 7f3960ff9640 1 -- 172.21.15.16:0/4132628601 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700ad390 con 0x55b0771e64d0 2024-09-21T00:47:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.165+0000 7f3960ff9640 1 -- 172.21.15.16:0/4132628601 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39700ad650 con 0x55b0771e64d0 2024-09-21T00:47:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- 172.21.15.16:0/4132628601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 msgr2=0x55b0775baef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 0x55b0775baef0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39700a9e50 tx=0x7f39700b21b0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- 172.21.15.16:0/4132628601 shutdown_connections 2024-09-21T00:47:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0772071b0 0x55b0775bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0771e64d0 0x55b0775baef0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 --2- 172.21.15.16:0/4132628601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771de2f0 0x55b0775aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- 172.21.15.16:0/4132628601 >> 172.21.15.16:0/4132628601 conn(0x55b0771fb300 msgr2=0x55b0775a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- 172.21.15.16:0/4132628601 shutdown_connections 2024-09-21T00:47:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- 172.21.15.16:0/4132628601 wait complete. 2024-09-21T00:47:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 -- start start 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.166+0000 7f39887f3740 1 Processor -- start 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771de2f0 0x55b0775c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1aa0d0 con 0x55b0771e64d0 2024-09-21T00:47:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1a9a00 con 0x55b0772071b0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1a6c60 con 0x55b0771de2f0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 10 client.0 _ll_register_callbacks cb 0x7f397000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397affd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771de2f0 0x55b0775c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39578/0 (socket says 172.21.15.16:39578) 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 -- 172.21.15.16:0/2704446140 learned_addr learned my addr 172.21.15.16:0/2704446140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397b7fe640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 -- 172.21.15.16:0/2704446140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771de2f0 msgr2=0x55b0775c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771de2f0 0x55b0775c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 -- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 msgr2=0x55b0775c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 -- 172.21.15.16:0/2704446140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0775c3cb0 con 0x55b0771e64d0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f397a7fc640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f39700b2220 tx=0x7f3970000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e6337198df9ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f395eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39700ad1d0 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f39700e72d0 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.167+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39700ad390 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39700a91d0 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0775c3cb0 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700ad390 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39700b6730 con 0x55b0771e64d0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 20 client.15873 populate_metadata read hostname 'smithi016' 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b07719b1c0 0x55b077636d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 4 client.15873 mds_command: new command op to 24677 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 --> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b07751f0f0 con 0x55b07719b1c0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.168+0000 7f397affd640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b07719b1c0 0x55b077636d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.169+0000 7f397affd640 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b07719b1c0 0x55b077636d70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f39544b44b5205ab server_cookie=abce04d7160a2891 in_seq=0 out_seq=0 2024-09-21T00:47:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.169+0000 7f395eff5640 10 client.15873 ms_handle_connect on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f395eff5640 1 -- 172.21.15.16:0/2704446140 <== mds.0 v2:172.21.15.123:6838/760564744 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b07751f0f0 con 0x55b07719b1c0 2024-09-21T00:47:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f395eff5640 10 client.15873 handle_command_reply: tid=0 2024-09-21T00:47:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 client.15873 shutdown 2024-09-21T00:47:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 msgr2=0x55b0775c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f39700b2220 tx=0x7f3970000bc0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 shutdown_connections 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:6838/760564744,v1:172.21.15.123:6839/760564744] conn(0x55b07719b1c0 0x55b077636d70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b0772071b0 0x55b0775c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f395eff5640 0 client.15873 ms_handle_reset on v2:172.21.15.123:6838/760564744 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b0771e64d0 0x55b0775c3200 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 --2- 172.21.15.16:0/2704446140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b0771de2f0 0x55b0775c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 >> 172.21.15.16:0/2704446140 conn(0x55b0771fb300 msgr2=0x55b0775b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 shutdown_connections 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 1 -- 172.21.15.16:0/2704446140 wait complete. 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.202+0000 7f39887f3740 20 client.15873 trim_cache size 0 max 16384 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:{ 2024-09-21T00:47:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "message": "", 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout: "return_code": 0 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stdout:} 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 msgr2=0x7f39640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 0x7f39640b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3974011550 tx=0x7f39740094e0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 msgr2=0x7f397c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9f0 tx=0x7f397000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 shutdown_connections 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f39640b6510 0x7f39640b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397c103fc0 0x7f397c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f397c103620 0x7f397c19a5a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 --2- 172.21.15.16:0/452020630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c1025a0 0x7f397c199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 >> 172.21.15.16:0/452020630 conn(0x7f397c0fdee0 msgr2=0x7f397c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 shutdown_connections 2024-09-21T00:47:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi016.front.sepia.ceph.com.smithi016.stderr:2024-09-21T00:47:55.203+0000 7f39817b0640 1 -- 172.21.15.16:0/452020630 wait complete. 2024-09-21T00:47:55.373 DEBUG:teuthology.parallel:result is None 2024-09-21T00:47:55.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T00:47:55.445 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T00:47:55.445 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T00:47:55.454 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:47:55.494 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T00:47:55.501 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T00:47:55.502 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T00:47:55.502 INFO:tasks.fwd_scrub:done joining 2024-09-21T00:47:55.502 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T00:47:55.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 -- 172.21.15.16:0/1796998777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec105090 msgr2=0x7f2cec10ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/1796998777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec105090 0x7f2cec10ba30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009ca0 tx=0x7f2ce402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 -- 172.21.15.16:0/1796998777 shutdown_connections 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/1796998777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec105090 0x7f2cec10ba30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/1796998777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec1046f0 0x7f2cec104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/1796998777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec103670 0x7f2cec103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 -- 172.21.15.16:0/1796998777 >> 172.21.15.16:0/1796998777 conn(0x7f2cec0fefd0 msgr2=0x7f2cec101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 -- 172.21.15.16:0/1796998777 shutdown_connections 2024-09-21T00:47:55.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 -- 172.21.15.16:0/1796998777 wait complete. 2024-09-21T00:47:55.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.647+0000 7f2cf1db0640 1 Processor -- start 2024-09-21T00:47:55.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 -- start start 2024-09-21T00:47:55.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec1046f0 0x7f2cec19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 0x7f2cec19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f2c0 con 0x7f2cec103670 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f140 con 0x7f2cec105090 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cf1db0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f440 con 0x7f2cec1046f0 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39594/0 (socket says 172.21.15.16:39594) 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 -- 172.21.15.16:0/2889511692 learned_addr learned my addr 172.21.15.16:0/2889511692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ce2ffd640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec1046f0 0x7f2cec19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cebfff640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 0x7f2cec19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 -- 172.21.15.16:0/2889511692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec1046f0 msgr2=0x7f2cec19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec1046f0 0x7f2cec19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 -- 172.21.15.16:0/2889511692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 msgr2=0x7f2cec19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 0x7f2cec19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2ceb7fe640 1 -- 172.21.15.16:0/2889511692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec19b900 con 0x7f2cec103670 2024-09-21T00:47:55.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.648+0000 7f2cebfff640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 0x7f2cec19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2ceb7fe640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00d770 tx=0x7f2cdc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc017070 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cdc0054d0 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec19bbf0 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004c30 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.649+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec1a22e0 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.650+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec10a840 con 0x7f2cec103670 2024-09-21T00:47:55.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.651+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2cdc004dd0 con 0x7f2cec103670 2024-09-21T00:47:55.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.652+0000 7f2ce97fa640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 0x7f2cd80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.652+0000 7f2ce2ffd640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 0x7f2cd80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.652+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f2cdc0e7140 con 0x7f2cec103670 2024-09-21T00:47:55.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.653+0000 7f2ce2ffd640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 0x7f2cd80b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400bbe0 tx=0x7f2cd400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.655+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cdc0ada40 con 0x7f2cec103670 2024-09-21T00:47:55.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:55 smithi016 ceph-mon[30947]: pgmap v399: 97 pgs: 97 active+clean; 350 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-09-21T00:47:55.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:55 smithi123 ceph-mon[34853]: pgmap v399: 97 pgs: 97 active+clean; 350 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-09-21T00:47:55.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:55 smithi178 ceph-mon[34888]: pgmap v399: 97 pgs: 97 active+clean; 350 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 1.9 MiB/s wr, 1.19k op/s 2024-09-21T00:47:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.846+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cec063fc0 con 0x7f2cec103670 2024-09-21T00:47:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.847+0000 7f2ce97fa640 1 -- 172.21.15.16:0/2889511692 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f2cdc0b1e20 con 0x7f2cec103670 2024-09-21T00:47:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:47:55.848 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:47:55.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.849+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 msgr2=0x7f2cd80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.849+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 0x7f2cd80b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400bbe0 tx=0x7f2cd400b390 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.849+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 msgr2=0x7f2cec199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.849+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00d770 tx=0x7f2cdc00dc30 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 shutdown_connections 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f2cd80b6590 0x7f2cd80b8aa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cec105090 0x7f2cec19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec1046f0 0x7f2cec19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 --2- 172.21.15.16:0/2889511692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cec103670 0x7f2cec199ec0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 >> 172.21.15.16:0/2889511692 conn(0x7f2cec0fefd0 msgr2=0x7f2cec107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 shutdown_connections 2024-09-21T00:47:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.850+0000 7f2cf1db0640 1 -- 172.21.15.16:0/2889511692 wait complete. 2024-09-21T00:47:55.862 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:39:36.636978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:44:14.364094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:44:16.243088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:47:55.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T00:47:55.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 -- 172.21.15.16:0/335352819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51681025a0 msgr2=0x7f5168102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 --2- 172.21.15.16:0/335352819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51681025a0 0x7f5168102a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5158009900 tx=0x7f515802a410 comp rx=0 tx=0).stop 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 -- 172.21.15.16:0/335352819 shutdown_connections 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 --2- 172.21.15.16:0/335352819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5168103fc0 0x7f516810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 --2- 172.21.15.16:0/335352819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 0x7f5168103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 --2- 172.21.15.16:0/335352819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51681025a0 0x7f5168102a10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 -- 172.21.15.16:0/335352819 >> 172.21.15.16:0/335352819 conn(0x7f51680fdee0 msgr2=0x7f5168100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 -- 172.21.15.16:0/335352819 shutdown_connections 2024-09-21T00:47:55.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.977+0000 7f516cad5640 1 -- 172.21.15.16:0/335352819 wait complete. 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 Processor -- start 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 -- start start 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 0x7f5168199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 0x7f516819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f516810f330 con 0x7f5168103fc0 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f516810f1b0 con 0x7f5168103620 2024-09-21T00:47:55.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.978+0000 7f516cad5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f516810f4b0 con 0x7f51681025a0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f516659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 0x7f5168199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39614/0 (socket says 172.21.15.16:39614) 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f516659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 0x7f5168199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.16:35654/0 (socket says 172.21.15.16:35654) 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 -- 172.21.15.16:0/3254356493 learned_addr learned my addr 172.21.15.16:0/3254356493 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5165d9b640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 0x7f516819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 -- 172.21.15.16:0/3254356493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 msgr2=0x7f5168199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 0x7f5168199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 -- 172.21.15.16:0/3254356493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 msgr2=0x7f516819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 0x7f516819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 -- 172.21.15.16:0/3254356493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516819b960 con 0x7f5168103fc0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f5166d9d640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fd0 tx=0x7f516000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160017070 con 0x7f5168103fc0 2024-09-21T00:47:55.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516819bc50 con 0x7f5168103fc0 2024-09-21T00:47:55.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5160003e20 con 0x7f5168103fc0 2024-09-21T00:47:55.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160010460 con 0x7f5168103fc0 2024-09-21T00:47:55.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.979+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681a2340 con 0x7f5168103fc0 2024-09-21T00:47:55.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.980+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168109770 con 0x7f5168103fc0 2024-09-21T00:47:55.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.982+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5160003970 con 0x7f5168103fc0 2024-09-21T00:47:55.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.983+0000 7f515f7fe640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 0x7f51540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:55.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.983+0000 7f516659c640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 0x7f51540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:55.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.983+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f51600e6fe0 con 0x7f5168103fc0 2024-09-21T00:47:55.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.984+0000 7f516659c640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 0x7f51540b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5158000c00 tx=0x7f5158031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:55.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:55.986+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51600b1c40 con 0x7f5168103fc0 2024-09-21T00:47:56.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.175+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5168063fc0 con 0x7f5168103fc0 2024-09-21T00:47:56.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.175+0000 7f515f7fe640 1 -- 172.21.15.16:0/3254356493 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f51600b6b80 con 0x7f5168103fc0 2024-09-21T00:47:56.176 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-21T00:47:56.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 msgr2=0x7f51540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 0x7f51540b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5158000c00 tx=0x7f5158031400 comp rx=0 tx=0).stop 2024-09-21T00:47:56.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 msgr2=0x7f516819b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fd0 tx=0x7f516000b260 comp rx=0 tx=0).stop 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 shutdown_connections 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f51540b6510 0x7f51540b8a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5168103fc0 0x7f516819b140 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5168103620 0x7f516819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 --2- 172.21.15.16:0/3254356493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51681025a0 0x7f5168199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 >> 172.21.15.16:0/3254356493 conn(0x7f51680fdee0 msgr2=0x7f5168106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 shutdown_connections 2024-09-21T00:47:56.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.177+0000 7f516cad5640 1 -- 172.21.15.16:0/3254356493 wait complete. 2024-09-21T00:47:56.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T00:47:56.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 -- 172.21.15.16:0/3269842081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468103600 msgr2=0x7f5468103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 --2- 172.21.15.16:0/3269842081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468103600 0x7f5468103a10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f545c009900 tx=0x7f545c02a410 comp rx=0 tx=0).stop 2024-09-21T00:47:56.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 -- 172.21.15.16:0/3269842081 shutdown_connections 2024-09-21T00:47:56.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 --2- 172.21.15.16:0/3269842081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103fa0 0x7f546810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 --2- 172.21.15.16:0/3269842081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468103600 0x7f5468103a10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 --2- 172.21.15.16:0/3269842081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468102580 0x7f54681029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 -- 172.21.15.16:0/3269842081 >> 172.21.15.16:0/3269842081 conn(0x7f54680fdee0 msgr2=0x7f5468100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 -- 172.21.15.16:0/3269842081 shutdown_connections 2024-09-21T00:47:56.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.305+0000 7f546ef2b640 1 -- 172.21.15.16:0/3269842081 wait complete. 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 Processor -- start 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 -- start start 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 0x7f54681994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468103fa0 0x7f546819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f546810e1e0 con 0x7f5468102580 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f546810e060 con 0x7f5468103600 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ef2b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f546810e360 con 0x7f5468103fa0 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39632/0 (socket says 172.21.15.16:39632) 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 -- 172.21.15.16:0/1877044527 learned_addr learned my addr 172.21.15.16:0/1877044527 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f5467fff640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 0x7f54681994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546d4c8640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468103fa0 0x7f546819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 -- 172.21.15.16:0/1877044527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468103fa0 msgr2=0x7f546819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468103fa0 0x7f546819a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 -- 172.21.15.16:0/1877044527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 msgr2=0x7f54681994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 0x7f54681994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f546ccc7640 1 -- 172.21.15.16:0/1877044527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546819a870 con 0x7f5468102580 2024-09-21T00:47:56.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.306+0000 7f5467fff640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 0x7f54681994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f546ccc7640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f545800e9f0 tx=0x7f545800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545800cd80 con 0x7f5468102580 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54580054d0 con 0x7f5468102580 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546819ab60 con 0x7f5468102580 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458010690 con 0x7f5468102580 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.307+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54681a1250 con 0x7f5468102580 2024-09-21T00:47:56.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.308+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54681029f0 con 0x7f5468102580 2024-09-21T00:47:56.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.310+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5458004e90 con 0x7f5468102580 2024-09-21T00:47:56.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.310+0000 7f5465ffb640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 0x7f54500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.311+0000 7f5467fff640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 0x7f54500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.311+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f54580e77d0 con 0x7f5468102580 2024-09-21T00:47:56.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.311+0000 7f5467fff640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 0x7f54500b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f545c005f70 tx=0x7f545c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.315+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54580ae0f0 con 0x7f5468102580 2024-09-21T00:47:56.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.502+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f546802e640 con 0x7f5468102580 2024-09-21T00:47:56.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.503+0000 7f5465ffb640 1 -- 172.21.15.16:0/1877044527 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f54580b24d0 con 0x7f5468102580 2024-09-21T00:47:56.504 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 msgr2=0x7f54500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 0x7f54500b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f545c005f70 tx=0x7f545c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 msgr2=0x7f5468198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f545800e9f0 tx=0x7f545800edf0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 shutdown_connections 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f54500b6510 0x7f54500b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5468103fa0 0x7f546819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5468103600 0x7f54681994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 --2- 172.21.15.16:0/1877044527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5468102580 0x7f5468198e30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 >> 172.21.15.16:0/1877044527 conn(0x7f54680fdee0 msgr2=0x7f5468106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 shutdown_connections 2024-09-21T00:47:56.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.505+0000 7f546ef2b640 1 -- 172.21.15.16:0/1877044527 wait complete. 2024-09-21T00:47:56.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:56 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2889511692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:47:56.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:56 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3254356493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:47:56.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.632+0000 7f5071132640 1 -- 172.21.15.16:0/3230071340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 msgr2=0x7f506c102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.632+0000 7f5071132640 1 --2- 172.21.15.16:0/3230071340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c102a10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f505c009900 tx=0x7f505c02a410 comp rx=0 tx=0).stop 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.632+0000 7f5071132640 1 -- 172.21.15.16:0/3230071340 shutdown_connections 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.632+0000 7f5071132640 1 --2- 172.21.15.16:0/3230071340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 0x7f506c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 --2- 172.21.15.16:0/3230071340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 0x7f506c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 --2- 172.21.15.16:0/3230071340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c102a10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 -- 172.21.15.16:0/3230071340 >> 172.21.15.16:0/3230071340 conn(0x7f506c0fdee0 msgr2=0x7f506c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 -- 172.21.15.16:0/3230071340 shutdown_connections 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 -- 172.21.15.16:0/3230071340 wait complete. 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.633+0000 7f5071132640 1 Processor -- start 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 -- start start 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 0x7f506c19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 0x7f506c1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10e1f0 con 0x7f506c1025a0 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10e070 con 0x7f506c103620 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f5071132640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10e370 con 0x7f506c103fc0 2024-09-21T00:47:56.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39642/0 (socket says 172.21.15.16:39642) 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 -- 172.21.15.16:0/2806389085 learned_addr learned my addr 172.21.15.16:0/2806389085 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506b59e640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 0x7f506c1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506a59c640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 0x7f506c19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 -- 172.21.15.16:0/2806389085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 msgr2=0x7f506c1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 0x7f506c1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 -- 172.21.15.16:0/2806389085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 msgr2=0x7f506c19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 0x7f506c19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 -- 172.21.15.16:0/2806389085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c1a19e0 con 0x7f506c1025a0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.634+0000 7f506ad9d640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f505c006010 tx=0x7f505c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.635+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c03f030 con 0x7f506c1025a0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.635+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f505c003cb0 con 0x7f506c1025a0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.635+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c1a1c70 con 0x7f506c1025a0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.635+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c035070 con 0x7f506c1025a0 2024-09-21T00:47:56.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.635+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c1a21b0 con 0x7f506c1025a0 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.636+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c109770 con 0x7f506c1025a0 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.637+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f505c042030 con 0x7f506c1025a0 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.638+0000 7f5053fff640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 0x7f50540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.638+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f505c107f60 con 0x7f506c1025a0 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.638+0000 7f506a59c640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 0x7f50540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.639+0000 7f506a59c640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 0x7f50540b8aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5060005d00 tx=0x7f5060005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.642+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f505c0ce880 con 0x7f506c1025a0 2024-09-21T00:47:56.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:56 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2889511692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:47:56.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:56 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3254356493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:47:56.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:56 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2889511692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:47:56.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:56 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3254356493' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:47:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.833+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f506c02e890 con 0x7f506c1025a0 2024-09-21T00:47:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.834+0000 7f5053fff640 1 -- 172.21.15.16:0/2806389085 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f505c003e60 con 0x7f506c1025a0 2024-09-21T00:47:56.835 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-09-21T00:47:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 msgr2=0x7f50540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 0x7f50540b8aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5060005d00 tx=0x7f5060005c50 comp rx=0 tx=0).stop 2024-09-21T00:47:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 msgr2=0x7f506c06c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f505c006010 tx=0x7f505c004340 comp rx=0 tx=0).stop 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 shutdown_connections 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f50540b6590 0x7f50540b8aa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c103fc0 0x7f506c1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f506c103620 0x7f506c19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 --2- 172.21.15.16:0/2806389085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c1025a0 0x7f506c06c130 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.836+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 >> 172.21.15.16:0/2806389085 conn(0x7f506c0fdee0 msgr2=0x7f506c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.837+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 shutdown_connections 2024-09-21T00:47:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.837+0000 7f5071132640 1 -- 172.21.15.16:0/2806389085 wait complete. 2024-09-21T00:47:56.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T00:47:56.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 -- 172.21.15.16:0/3077290313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354103fa0 msgr2=0x7f635410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 --2- 172.21.15.16:0/3077290313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354103fa0 0x7f635410a940 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f634c009ca0 tx=0x7f634c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 -- 172.21.15.16:0/3077290313 shutdown_connections 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 --2- 172.21.15.16:0/3077290313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354103fa0 0x7f635410a940 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 --2- 172.21.15.16:0/3077290313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103600 0x7f6354103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 --2- 172.21.15.16:0/3077290313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354102580 0x7f63541029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 -- 172.21.15.16:0/3077290313 >> 172.21.15.16:0/3077290313 conn(0x7f63540fdee0 msgr2=0x7f6354100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 -- 172.21.15.16:0/3077290313 shutdown_connections 2024-09-21T00:47:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.960+0000 7f6358cb2640 1 -- 172.21.15.16:0/3077290313 wait complete. 2024-09-21T00:47:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 Processor -- start 2024-09-21T00:47:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 -- start start 2024-09-21T00:47:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354103600 0x7f635419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103fa0 0x7f635419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f635410e1e0 con 0x7f6354102580 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f635410e060 con 0x7f6354103600 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.961+0000 7f6358cb2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f635410e360 con 0x7f6354103fa0 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39666/0 (socket says 172.21.15.16:39666) 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 -- 172.21.15.16:0/1095434914 learned_addr learned my addr 172.21.15.16:0/1095434914 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f6351d9b640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354103600 0x7f635419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f6352d9d640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103fa0 0x7f635419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 -- 172.21.15.16:0/1095434914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103fa0 msgr2=0x7f635419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103fa0 0x7f635419d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 -- 172.21.15.16:0/1095434914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354103600 msgr2=0x7f635419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354103600 0x7f635419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 -- 172.21.15.16:0/1095434914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635419dae0 con 0x7f6354102580 2024-09-21T00:47:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f635259c640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f634400d950 tx=0x7f634400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344017030 con 0x7f6354102580 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6344004020 con 0x7f6354102580 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440047a0 con 0x7f6354102580 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635419ddd0 con 0x7f6354102580 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.962+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63541a44c0 con 0x7f6354102580 2024-09-21T00:47:56.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.963+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63541a46f0 con 0x7f6354102580 2024-09-21T00:47:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.965+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6344009a30 con 0x7f6354102580 2024-09-21T00:47:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.966+0000 7f63437fe640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 0x7f633c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:47:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.966+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f63440e73c0 con 0x7f6354102580 2024-09-21T00:47:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.966+0000 7f6351d9b640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 0x7f633c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:47:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.966+0000 7f6351d9b640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 0x7f633c0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6348009b50 tx=0x7f6348005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:47:56.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:56.969+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63440adcc0 con 0x7f6354102580 2024-09-21T00:47:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.208+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f63541a48c0 con 0x7f6354102580 2024-09-21T00:47:57.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.216+0000 7f63437fe640 1 -- 172.21.15.16:0/1095434914 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v19) ==== 81+0+833522 (secure 0 0 0) 0x7f63440b20a0 con 0x7f6354102580 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "epoch": 19, 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "active_gid": 14152, 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "active_name": "x", 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "active_addrs": { 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:6800", 2024-09-21T00:47:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 4223283672 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:6801", 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 4223283672 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "active_addr": "172.21.15.16:6801/4223283672", 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "active_change": "2024-09-21T00:36:46.160651+0000", 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "available": true, 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "standbys": [ 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "gid": 24124, 2024-09-21T00:47:57.228 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "z", 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_features": 4540719139924082687, 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.229 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.231 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.232 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.234 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.235 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.236 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.237 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.238 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.239 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.240 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.241 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.242 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.244 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.245 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-21T00:47:57.246 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.247 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-21T00:47:57.249 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.250 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-21T00:47:57.251 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.252 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T00:47:57.253 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.254 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.255 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.256 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.257 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.260 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.262 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.263 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.264 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T00:47:57.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.266 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.267 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.268 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-21T00:47:57.270 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.272 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.273 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.274 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.275 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.276 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.277 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.278 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-21T00:47:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-21T00:47:57.280 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-21T00:47:57.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.282 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.283 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.286 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.287 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.288 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.295 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.296 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-21T00:47:57.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.299 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.301 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.302 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.303 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.304 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.305 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-21T00:47:57.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-21T00:47:57.310 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-21T00:47:57.311 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.313 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T00:47:57.314 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T00:47:57.315 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.316 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.317 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.322 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:57.323 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.327 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.328 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T00:47:57.330 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.331 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.332 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.333 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.334 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.335 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_count_max": { 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.336 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_interval": { 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_interval", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T00:47:57.337 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.338 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.340 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T00:47:57.341 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.342 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-21T00:47:57.343 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.345 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.346 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.347 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.348 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.349 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.351 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.352 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.353 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.354 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.355 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.356 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.358 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.359 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.360 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.361 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.362 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.368 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.369 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.370 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.371 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.372 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.373 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.374 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T00:47:57.375 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.377 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T00:47:57.378 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.379 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.380 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.382 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T00:47:57.383 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T00:47:57.384 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T00:47:57.385 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T00:47:57.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T00:47:57.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.388 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.389 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.390 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T00:47:57.391 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T00:47:57.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T00:47:57.393 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T00:47:57.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.395 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.396 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.397 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T00:47:57.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.399 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.400 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.402 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-21T00:47:57.404 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-21T00:47:57.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.406 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.408 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.409 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.410 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.412 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.413 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.414 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.415 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.416 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.417 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.418 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.419 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.420 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "sso_oauth2": { 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sso_oauth2", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.421 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.422 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-21T00:47:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.434 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.435 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-21T00:47:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.442 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.443 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.444 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.445 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.446 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.448 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.449 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.450 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.451 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-21T00:47:57.452 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-21T00:47:57.453 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-21T00:47:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.457 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.458 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.459 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.461 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.462 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.463 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.465 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.470 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.471 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.473 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.474 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.475 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.476 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.477 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.478 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.479 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.480 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.481 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.482 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.483 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.484 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.485 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.486 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.487 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.488 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.489 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.491 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.492 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.494 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.495 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.497 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.498 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.499 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.500 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.501 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.503 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.504 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.505 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.507 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.510 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.511 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.512 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.513 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.514 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.516 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.517 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.519 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.520 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.521 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.522 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.523 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.525 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.526 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.527 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:57.528 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.529 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.530 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.531 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.532 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.533 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.534 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.537 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.539 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.540 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.542 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.543 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.544 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.545 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.546 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.547 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.548 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.549 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.550 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.553 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.556 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.557 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.558 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.559 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:57.560 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.561 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.562 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.563 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.564 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.565 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.566 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.568 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-21T00:47:57.569 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.570 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.571 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-21T00:47:57.572 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.573 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.574 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.575 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.576 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.577 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.580 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.581 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.582 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.583 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.584 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:57.585 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:57.586 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.587 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.588 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-21T00:47:57.590 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.591 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.592 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.593 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.594 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.595 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.596 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-21T00:47:57.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-21T00:47:57.598 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.599 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-21T00:47:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.602 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.603 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.604 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.606 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.607 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T00:47:57.609 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.614 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.615 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.617 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.617 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.617 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.618 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.619 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.620 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.621 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.622 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.625 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.626 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.628 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.629 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.631 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.632 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.633 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.634 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.635 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.637 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.638 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.639 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-21T00:47:57.640 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-21T00:47:57.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-21T00:47:57.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.643 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.644 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.645 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.647 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.648 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.649 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.652 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.653 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.654 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.656 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.657 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.660 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.661 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.662 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.663 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.664 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.665 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.667 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.669 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.670 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.671 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.672 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.677 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.678 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.680 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.684 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.686 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.687 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.691 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.692 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-21T00:47:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-21T00:47:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-21T00:47:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-21T00:47:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-21T00:47:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-21T00:47:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-21T00:47:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "gid": 24137, 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "y", 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_features": 4540719139924082687, 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-21T00:47:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-21T00:47:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-21T00:47:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-21T00:47:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.788 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.789 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-21T00:47:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-21T00:47:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.814 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.815 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.816 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-21T00:47:57.817 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.819 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T00:47:57.821 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.822 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.823 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-21T00:47:57.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.825 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-21T00:47:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.827 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.828 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.830 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.831 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-21T00:47:57.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.836 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.837 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-21T00:47:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.839 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-21T00:47:57.841 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.842 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.843 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-21T00:47:57.844 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.845 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.846 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.847 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.848 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-21T00:47:57.849 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.850 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.851 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-21T00:47:57.852 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T00:47:57.853 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-21T00:47:57.854 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-21T00:47:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-21T00:47:57.856 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T00:47:57.857 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.858 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T00:47:57.859 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-21T00:47:57.860 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.861 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.862 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.863 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.865 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T00:47:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T00:47:57.867 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.868 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.869 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T00:47:57.870 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.871 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.873 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-21T00:47:57.875 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.876 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.877 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.878 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.879 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.880 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-21T00:47:57.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-21T00:47:57.882 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.883 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.887 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_count_max": { 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.888 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_interval": { 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_interval", 2024-09-21T00:47:57.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.890 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T00:47:57.891 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.892 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.893 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.894 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.896 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.897 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.899 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.900 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.902 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-21T00:47:57.903 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.904 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.905 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.907 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.908 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.909 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.910 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.911 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.913 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.914 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.915 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.916 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.917 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.918 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.920 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.921 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.922 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.923 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.924 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.926 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T00:47:57.927 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T00:47:57.928 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.929 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.930 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.931 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.932 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.933 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T00:47:57.934 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.935 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.936 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.937 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.938 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.939 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.940 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.941 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.945 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.946 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.947 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.948 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.949 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.950 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.951 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T00:47:57.952 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.953 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.959 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.960 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.961 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T00:47:57.962 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T00:47:57.962 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.962 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.962 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.963 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.964 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:57.965 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.966 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.966 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.966 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.966 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.967 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.967 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.968 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.969 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.971 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.972 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.972 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.972 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.973 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.973 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.973 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.973 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.974 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-21T00:47:57.974 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-21T00:47:57.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.975 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.975 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-21T00:47:57.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.977 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:57.978 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.980 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.981 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.982 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.982 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.982 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.983 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.983 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.984 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.985 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.985 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.985 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.985 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.985 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.986 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.986 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.986 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.986 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.987 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:57.987 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:57.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:57.988 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.989 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:57.990 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.991 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.992 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.993 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:57.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.995 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.996 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "sso_oauth2": { 2024-09-21T00:47:57.997 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sso_oauth2", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:57.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:57.999 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.001 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-21T00:47:58.002 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.004 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.005 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.006 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.008 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.011 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.012 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.017 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.019 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.020 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.022 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.023 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.024 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.025 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.025 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.026 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-21T00:47:58.027 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-21T00:47:58.028 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.028 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-21T00:47:58.029 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-21T00:47:58.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.029 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.030 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-21T00:47:58.031 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.031 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.031 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.032 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T00:47:58.032 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.033 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.034 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-21T00:47:58.034 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-21T00:47:58.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.035 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.036 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.036 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-21T00:47:58.036 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.037 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.037 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.037 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T00:47:58.038 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.039 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.039 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-21T00:47:58.039 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.040 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.043 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.044 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.045 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.047 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.049 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.051 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.052 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.054 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.055 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.057 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.059 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.060 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.062 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.063 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.064 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.065 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.067 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.068 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.069 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.070 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.072 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.073 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.075 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.078 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.079 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.080 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-21T00:47:58.081 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.083 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.084 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.085 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.086 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.087 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-21T00:47:58.088 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-21T00:47:58.089 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.090 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.091 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T00:47:58.093 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.095 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.096 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.097 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.098 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.099 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.101 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.102 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.103 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.104 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.105 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.106 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.107 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.108 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.109 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.110 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.111 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.113 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.114 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.115 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.116 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.118 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.121 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.122 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.124 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.125 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.126 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.127 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.128 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.130 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.131 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.132 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.133 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.134 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.135 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.136 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.137 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.138 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.139 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.142 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.143 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.144 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.145 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.146 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.151 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.152 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.154 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.155 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-21T00:47:58.156 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-21T00:47:58.157 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.158 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.159 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.160 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.161 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.162 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.163 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.164 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.166 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.167 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-21T00:47:58.170 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.171 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:58.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.174 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.175 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.176 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.177 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.178 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.179 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.181 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-21T00:47:58.182 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.187 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.188 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.189 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.190 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.192 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.193 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.194 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.196 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.198 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.199 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.200 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.201 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.202 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-21T00:47:58.203 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.204 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.205 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.206 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.207 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.211 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.212 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.214 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.215 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.216 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.217 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.218 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.219 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.220 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.221 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.222 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.223 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.224 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.226 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.227 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.228 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.230 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.231 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.233 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.234 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.235 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.236 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.237 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-21T00:47:58.238 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.239 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.240 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.246 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.248 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.250 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.252 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.254 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.256 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.259 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.260 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.261 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.263 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.264 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.265 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.266 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.268 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.269 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.270 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.272 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.273 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.274 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.275 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.276 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.277 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.278 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.279 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.282 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.283 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.284 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.285 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.286 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.287 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.288 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.289 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.295 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.297 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.298 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.299 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.300 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.301 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.302 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.303 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.304 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.305 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.306 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.307 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.308 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-21T00:47:58.310 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T00:47:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.313 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-21T00:47:58.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-21T00:47:58.315 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.316 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.317 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.318 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.320 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.321 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.322 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.323 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.324 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-21T00:47:58.325 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T00:47:58.326 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.327 INFO:teuthology.orchestra.run.smithi016.stdout: "modules": [ 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "dashboard", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "iostat", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "nfs", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "restful" 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.328 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.329 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.330 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.331 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.332 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.333 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.334 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.335 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.336 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.337 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.338 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.339 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.340 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.342 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.344 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-21T00:47:58.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.350 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T00:47:58.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.352 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-21T00:47:58.353 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.354 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.357 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.358 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.359 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.360 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T00:47:58.362 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T00:47:58.363 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.364 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.365 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.366 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.367 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T00:47:58.368 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T00:47:58.369 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.370 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T00:47:58.371 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.372 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.373 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.374 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-21T00:47:58.375 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-21T00:47:58.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-21T00:47:58.377 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.378 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.380 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.381 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.382 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.383 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.384 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.385 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.386 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.389 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.391 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T00:47:58.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.393 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.395 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T00:47:58.397 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.398 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.399 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.400 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-21T00:47:58.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-21T00:47:58.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-21T00:47:58.404 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.408 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.409 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.411 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.413 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.414 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.415 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.416 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.418 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.419 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.420 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.421 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.422 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T00:47:58.424 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.425 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.426 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.428 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.432 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.433 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.434 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_count_max": { 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.435 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_keepalive_interval": { 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_keepalive_interval", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.436 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.437 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.440 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.441 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-21T00:47:58.442 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-21T00:47:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-21T00:47:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.455 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.456 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.457 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.458 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.459 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.460 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.461 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.462 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.463 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.466 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.467 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.469 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.470 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:58.471 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.472 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.477 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.478 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.480 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T00:47:58.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.483 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.484 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.485 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.486 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.487 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.488 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.489 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.490 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.491 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.492 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T00:47:58.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.496 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.497 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.498 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.499 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.502 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.503 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.504 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.505 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.507 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.508 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.509 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.510 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.512 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-21T00:47:58.513 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.515 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.519 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "sso_oauth2": { 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sso_oauth2", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.521 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.522 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.523 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.524 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-21T00:47:58.525 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.527 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.528 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.529 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.530 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.531 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.532 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.533 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-21T00:47:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-21T00:47:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-21T00:47:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-21T00:47:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-21T00:47:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-21T00:47:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T00:47:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.582 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-21T00:47:58.583 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.584 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.587 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.588 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.589 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.590 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.591 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T00:47:58.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.594 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.595 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.597 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.598 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.600 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-21T00:47:58.601 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.602 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.604 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-21T00:47:58.605 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.606 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.608 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.609 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.610 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.612 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.613 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.614 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.615 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.616 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.617 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.618 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-21T00:47:58.619 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.620 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.621 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.622 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.623 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.625 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.626 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.628 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.629 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.630 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-21T00:47:58.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.633 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.634 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.635 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.637 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.638 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.639 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.640 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.641 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.642 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.644 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.645 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.646 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.647 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.648 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.649 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.651 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.652 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.653 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.655 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.656 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.658 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.661 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.662 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.663 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.664 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.667 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.669 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.670 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.671 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-21T00:47:58.676 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T00:47:58.677 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.678 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.680 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.683 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-21T00:47:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.685 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-21T00:47:58.686 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.687 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.688 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.690 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.691 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.692 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.694 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.695 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-21T00:47:58.696 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.697 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.698 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.699 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.700 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.701 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.702 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.703 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-21T00:47:58.704 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-21T00:47:58.705 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.707 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.708 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.710 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.711 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.712 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.713 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.714 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.715 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.716 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.717 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.718 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.719 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.721 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.722 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.724 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.725 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.726 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.727 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.728 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-21T00:47:58.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-21T00:47:58.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-21T00:47:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-21T00:47:58.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-21T00:47:58.733 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.734 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-21T00:47:58.736 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-21T00:47:58.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-21T00:47:58.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.740 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.741 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.743 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.744 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.747 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.749 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.750 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.751 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.754 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.755 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.758 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.759 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.760 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.761 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.762 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.763 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.764 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.766 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.767 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.768 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.770 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.771 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.772 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.773 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.774 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.778 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.779 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.780 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.781 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-21T00:47:58.782 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T00:47:58.783 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.784 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.785 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.786 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.787 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.788 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.789 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.790 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.791 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.792 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.793 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.795 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.796 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.799 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.800 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-21T00:47:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-21T00:47:58.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.806 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.807 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.811 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.813 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.814 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.815 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.816 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.817 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.818 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.819 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.820 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.821 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.822 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-21T00:47:58.823 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.824 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.827 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-21T00:47:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.831 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.834 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-21T00:47:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "services": { 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "dashboard": "https://172.21.15.16:8443/" 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "always_on_modules": { 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "octopus": [ 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-21T00:47:58.836 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "pacific": [ 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-21T00:47:58.837 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "quincy": [ 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-21T00:47:58.838 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "reef": [ 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-21T00:47:58.839 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-21T00:47:58.840 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-21T00:47:58.840 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-21T00:47:58.840 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-21T00:47:58.840 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "squid": [ 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-21T00:47:58.841 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "last_failure_osd_epoch": 3, 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "active_clients": [ 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-21T00:47:58.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 4140210188 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "libcephsqlite", 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3858925140 2024-09-21T00:47:58.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 1704008738 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.844 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 239570127 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-21T00:47:58.845 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 msgr2=0x7f633c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 0x7f633c0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6348009b50 tx=0x7f6348005f90 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 msgr2=0x7f635419c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f634400d950 tx=0x7f634400de10 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 shutdown_connections 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f633c0b6590 0x7f633c0b8aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6354103fa0 0x7f635419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6354103600 0x7f635419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 --2- 172.21.15.16:0/1095434914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6354102580 0x7f635419c0a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 >> 172.21.15.16:0/1095434914 conn(0x7f63540fdee0 msgr2=0x7f63540ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:47:58.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 shutdown_connections 2024-09-21T00:47:58.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:47:57.222+0000 7f6358cb2640 1 -- 172.21.15.16:0/1095434914 wait complete. 2024-09-21T00:47:58.897 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T00:47:58.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T00:47:58.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:57 smithi016 ceph-mon[30947]: pgmap v400: 97 pgs: 97 active+clean; 178 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 2.1 MiB/s wr, 678 op/s 2024-09-21T00:47:58.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1877044527' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2806389085' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:57 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1095434914' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:57 smithi178 ceph-mon[34888]: pgmap v400: 97 pgs: 97 active+clean; 178 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 2.1 MiB/s wr, 678 op/s 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1877044527' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2806389085' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:57 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1095434914' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:57 smithi123 ceph-mon[34853]: pgmap v400: 97 pgs: 97 active+clean; 178 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 2.1 MiB/s wr, 678 op/s 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1877044527' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2806389085' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:47:58.899 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:57 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1095434914' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T00:47:59.169 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:47:59.474 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:47:59 smithi016 ceph-mon[30947]: pgmap v401: 97 pgs: 97 active+clean; 121 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 148 MiB/s rd, 1.7 MiB/s wr, 559 op/s 2024-09-21T00:47:59.520 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:47:59 smithi123 ceph-mon[34853]: pgmap v401: 97 pgs: 97 active+clean; 121 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 148 MiB/s rd, 1.7 MiB/s wr, 559 op/s 2024-09-21T00:47:59.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:47:59 smithi178 ceph-mon[34888]: pgmap v401: 97 pgs: 97 active+clean; 121 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 148 MiB/s rd, 1.7 MiB/s wr, 559 op/s 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 286, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 282, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 578608, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 107358, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 5, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.039168707, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.016677802, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.017059709, 2024-09-21T00:47:59.767 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.006226197, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 281, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.012355296, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000043969 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 508384, 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 40896 2024-09-21T00:47:59.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 137, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 186, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 34268, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 209572, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 5, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 4, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.019946247, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.009351943, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.004676805, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.004358298, 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:47:59.769 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 184, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.008525092, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000046332 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 166256 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 219, 2024-09-21T00:47:59.770 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 218, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 60575, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 68501, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 3, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.022681528, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.008833747, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.007299481, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.004962028, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 217, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.011936567, 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000055007 2024-09-21T00:47:59.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-21T00:47:59.772 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 959, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.026623086, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000027761 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 0, 2024-09-21T00:47:59.774 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 0, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 1, 2024-09-21T00:47:59.775 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 0, 2024-09-21T00:47:59.776 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 0, 2024-09-21T00:47:59.777 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 0 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 0, 2024-09-21T00:47:59.778 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:47:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_succeeded": 0, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_write_failed": 0 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.780 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 4, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 2, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 2, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 0, 2024-09-21T00:47:59.781 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 4194304, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 4195424, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 4195283, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 4 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 3, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 3, 2024-09-21T00:47:59.782 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 1, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 1, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 0, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 118856, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 316420096 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-21T00:47:59.783 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.784 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-21T00:47:59.785 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-21T00:47:59.786 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.787 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.788 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-21T00:47:59.789 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.790 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.791 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.792 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-21T00:47:59.793 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.794 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 1, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 1, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 1, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 0, 2024-09-21T00:47:59.795 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 1063, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:47:59.796 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:47:59.797 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 189279, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 49, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:47:59.798 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 7312, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 151, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 8672, 2024-09-21T00:47:59.799 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 13, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 559, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 21, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 3, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 559, 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-21T00:47:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 559, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.355994659, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000636841 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 559, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 560 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 559, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 559, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 0, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-21T00:47:59.801 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 342, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 215, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 1, 2024-09-21T00:47:59.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-21T00:47:59.803 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 75, 2024-09-21T00:47:59.804 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 2, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 5, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 5, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 2, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 0 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-21T00:47:59.805 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:47:59.806 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 638, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 609117, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 638, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 638, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 609117, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 559, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 1125, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 559, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 1125, 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:47:59.808 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 559, 2024-09-21T00:47:59.809 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 559, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 559, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 559, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:47:59.810 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x556948f45380": { 2024-09-21T00:47:59.811 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:47:59.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:47:59.813 INFO:teuthology.orchestra.run.smithi016.stdout: "trackedop": { 2024-09-21T00:47:59.813 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 0 2024-09-21T00:47:59.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:47:59.813 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:48:00.666 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T00:48:00.666 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T00:48:00.666 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T00:48:00.666 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T00:48:00.666 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T00:48:00.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T00:48:00.923 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:01.465 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:48:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 76, 2024-09-21T00:48:01.465 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 73, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 487216, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 43712, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.015712797, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.005672914, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.013642559, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 72, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003892336, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000054060 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.466 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 487216, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 43712 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 5, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 57, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 3152, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 90368, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:01.467 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.008219786, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.004244506, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.003499044, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 56, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.006640920, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000118587 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T00:48:01.468 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 90368 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 0, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 2, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 0, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 0, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.000406902, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.000331373, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:01.469 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-21T00:48:01.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:01.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:01.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148823, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 27, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:01.473 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-21T00:48:01.474 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 77, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 476533, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 77, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:48:01.475 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 77, 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 476533, 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:01.476 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:48:01.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:01 smithi016 ceph-mon[30947]: pgmap v402: 97 pgs: 97 active+clean; 37 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 1.1 MiB/s wr, 453 op/s 2024-09-21T00:48:01.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:01 smithi123 ceph-mon[34853]: pgmap v402: 97 pgs: 97 active+clean; 37 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 1.1 MiB/s wr, 453 op/s 2024-09-21T00:48:01.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:01 smithi178 ceph-mon[34888]: pgmap v402: 97 pgs: 97 active+clean; 37 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 1.1 MiB/s wr, 453 op/s 2024-09-21T00:48:02.210 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T00:48:02.210 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T00:48:02.210 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T00:48:02.210 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T00:48:02.210 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T00:48:02.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T00:48:02.466 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:02.976 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 213, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 215, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 71513, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 67735, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 6, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.028761182, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.013252669, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.006223740, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.006240170, 2024-09-21T00:48:02.977 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 213, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.010577605, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000049660 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.978 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 431, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 427, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 600096, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 154169, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 3, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.041210079, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.016493019, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.018744089, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.008461995, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 426, 2024-09-21T00:48:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.016580739, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000038921 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 508928, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 42176 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 8, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 57, 2024-09-21T00:48:02.980 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 4500, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 171301, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 5, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 4, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.007751929, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.003245120, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.004066168, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000083763, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 56, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.007374947, 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000131695 2024-09-21T00:48:02.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 170336 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-21T00:48:02.982 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 991, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.025616021, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000025848 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:02.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 0, 2024-09-21T00:48:02.984 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 1, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 0, 2024-09-21T00:48:02.985 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 0, 2024-09-21T00:48:02.986 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 0 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:02.988 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:02.989 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_write_failed": 0 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 0, 2024-09-21T00:48:02.990 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 4, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 2, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 2, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 0, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 4194304, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 4195424, 2024-09-21T00:48:02.991 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 4195283, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 4 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 3, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 3, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 0, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 1, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 1, 2024-09-21T00:48:02.992 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 116368, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 315371520 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:02.993 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:02.994 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.995 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.996 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.997 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.998 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:02.999 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.001 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.003 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 0, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 1, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 1, 2024-09-21T00:48:03.005 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 1, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 1065, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:03.006 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:03.007 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 197319, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 52, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 151, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 8672, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 13, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-21T00:48:03.010 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 568, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 21, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 3, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 568, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 568, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.323995139, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000570413 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 568, 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 569 2024-09-21T00:48:03.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 568, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 568, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 348, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 218, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 0, 2024-09-21T00:48:03.012 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 1, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-21T00:48:03.013 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-21T00:48:03.014 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 75, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 2, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 6, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 6, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 0, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 2, 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 0 2024-09-21T00:48:03.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 0, 2024-09-21T00:48:03.016 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 648, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 610771, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 648, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 648, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 610771, 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 568, 2024-09-21T00:48:03.018 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 1125, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 568, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 1125, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:48:03.019 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 568, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 568, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 568, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 568, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:03.020 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x5637d27b96c0": { 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:03.022 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: "trackedop": { 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 0 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:03.023 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:48:03.750 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:03 smithi016 ceph-mon[30947]: pgmap v403: 97 pgs: 97 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2024-09-21T00:48:03.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:03 smithi123 ceph-mon[34853]: pgmap v403: 97 pgs: 97 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2024-09-21T00:48:03.779 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T00:48:03.779 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T00:48:03.779 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-21T00:48:03.779 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-21T00:48:03.779 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T00:48:03.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T00:48:03.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:03 smithi178 ceph-mon[34888]: pgmap v403: 97 pgs: 97 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2024-09-21T00:48:04.039 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 77, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 74, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 487488, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 44352, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-21T00:48:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.015884223, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.006012612, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.013526328, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 73, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003975599, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000054460 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 487488, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 44352 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 56, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 160, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 90096, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.005723423, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.003826704, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.001343980, 2024-09-21T00:48:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 54, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.002454803, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000045459 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 90096 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 4, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 4, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 2992, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 448, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.002258672, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000043247, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.002227276, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3, 2024-09-21T00:48:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003893582, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001297860 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-21T00:48:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148823, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 27, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-21T00:48:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-21T00:48:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 78, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 476663, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 78, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-21T00:48:04.591 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 78, 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 476663, 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-21T00:48:04.592 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-21T00:48:05.304 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T00:48:05.304 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T00:48:05.304 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T00:48:05.304 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T00:48:05.304 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T00:48:05.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T00:48:05.566 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:48:05.687 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:05 smithi123 ceph-mon[34853]: pgmap v404: 97 pgs: 97 active+clean; 4.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 917 KiB/s wr, 326 op/s 2024-09-21T00:48:05.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:05 smithi016 ceph-mon[30947]: pgmap v404: 97 pgs: 97 active+clean; 4.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 917 KiB/s wr, 326 op/s 2024-09-21T00:48:05.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:05 smithi178 ceph-mon[34888]: pgmap v404: 97 pgs: 97 active+clean; 4.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 917 KiB/s wr, 326 op/s 2024-09-21T00:48:06.108 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T00:48:06.108 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:06.108 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3469, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3619, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 891264, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 9671042, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 11, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.300679642, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.142241108, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.076474949, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.068407616, 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:06.109 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3617, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.805407230, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000222672 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1006, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000258654, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000257 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.110 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3238, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3292, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 1462742, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 5438023, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 11, 2024-09-21T00:48:06.111 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 7, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.274595293, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.116577137, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.082914012, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.068001354, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3292, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.658946877, 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000503932 2024-09-21T00:48:06.112 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 500, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000205603, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000411 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 546448, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 49728 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.113 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 6299, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 11095, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 2084126, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 5061593, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 43, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 7, 2024-09-21T00:48:06.114 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.615919252, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.333361695, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.297121334, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.036737250, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 11093, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.360326365, 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000032482 2024-09-21T00:48:06.115 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 13596, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002410432, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000177 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 52720, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 206752 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.116 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4500, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 2.258771820, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000501949 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 5617, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.246435027, 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000043873 2024-09-21T00:48:06.117 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 2473, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 2473, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2473, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 2.893629148, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001170088 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 52, 2024-09-21T00:48:06.118 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 120, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 72, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 48, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 112, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 4, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 4, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 2506, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 2492, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-21T00:48:06.119 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 7016, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 1, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 24, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 4, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 234, 2024-09-21T00:48:06.120 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 24, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 16, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 2, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 14, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 8, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 33, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 3640, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:06.121 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 2450, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 1212, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 12, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 1242 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 26, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 40, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:06.122 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 1212, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 1212, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 2, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T00:48:06.123 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 6119, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 6012, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 6012, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 107, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 5925, 2024-09-21T00:48:06.124 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 16, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 15, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 15, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 1, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 1, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 8, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 16674349, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 16759088, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2442, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4.003738292, 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001639532 2024-09-21T00:48:06.125 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 24, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 1237, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 1213, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 18, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 24, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 6, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 120, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 1243, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 1123, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 3, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 1226, 2024-09-21T00:48:06.126 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 1223, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 125732, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 340602880 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 2535, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 2473, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 9, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1210, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.154043031, 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000953754 2024-09-21T00:48:06.127 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 17, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.004951594, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000291270 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.128 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000243229, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000243229 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000356562, 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000178281 2024-09-21T00:48:06.129 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.130 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.131 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 12, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.016874741, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001406228 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000353213, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000353213 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.006275873, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001045978 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T00:48:06.133 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002267141, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001133570 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.134 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6, 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.034606203, 2024-09-21T00:48:06.135 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005767700 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.136 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000867979, 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000867979 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:06.137 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.138 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 9, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.022727747, 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002525305 2024-09-21T00:48:06.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1206, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.650061835, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001368210 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:06.140 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 2, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 2254, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 2254, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 108, 2024-09-21T00:48:06.141 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:06.142 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:06.143 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 1100584, 2024-09-21T00:48:06.144 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 424, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 440, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 5, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 151, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:06.145 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 442966, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 11688, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 6814, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 12925587, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-21T00:48:06.146 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 6814, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6814, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 32.266233934, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004735285 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6814, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7192 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 6814, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 57, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 6757, 2024-09-21T00:48:06.147 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 32, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 130, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 31, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2471, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 43, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 4014, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 26, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 260, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T00:48:06.149 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T00:48:06.150 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 75, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 12, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 12, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 160, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 25 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T00:48:06.151 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 9, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 4, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 3498, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 1212, 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:06.152 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 13002, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 3252764, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 13002, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 13002, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 3252764, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.153 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 6814, 2024-09-21T00:48:06.154 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 13047999, 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 6814, 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 13047999, 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 6814, 2024-09-21T00:48:06.156 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 6814, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 6814, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 6814, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.157 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 1212, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 122412, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 1212, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:06.158 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 29, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 122412, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55e9755052b0": { 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 599, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:06.159 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 6119, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 12564784, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 6119, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2442, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 12564185, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:06.160 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T00:48:06.161 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T00:48:06.161 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:06.161 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T00:48:06.958 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T00:48:06.958 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T00:48:06.958 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=26 2024-09-21T00:48:06.958 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T00:48:06.959 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T00:48:06.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T00:48:07.213 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:48:07.505 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:07 smithi123 ceph-mon[34853]: pgmap v405: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 MiB/s rd, 619 KiB/s wr, 257 op/s 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 328, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 252, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 123877, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 81785, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:07.757 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.041465691, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.018198215, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.021967390, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.001498775, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 255, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.046984043, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000184251 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 523, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000107523, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000205 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.758 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 144, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 136, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 542590, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 90717, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.023869996, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.008472960, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.021322196, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000533002, 2024-09-21T00:48:07.759 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 135, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.024241464, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000179566 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 21, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000005198, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000247 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 529488, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 50336 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 27, 2024-09-21T00:48:07.760 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 85, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 12839, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 263246, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 16, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.012564422, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.004580947, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.007051494, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000141520, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 79, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.016433703, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000208021 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.761 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 28, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000005932, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000211 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 171168 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T00:48:07.762 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 50, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.001257722, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000025154 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000023093, 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000011546 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 11, 2024-09-21T00:48:07.764 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 18, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 2, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 16, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 13, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 8, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 3, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 9, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 6, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-21T00:48:07.765 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 3, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 4, 2024-09-21T00:48:07.766 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 234, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:07.767 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 15, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 9, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 10, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:07.768 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 4, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 4, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-21T00:48:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 2, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 2, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4195424, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.005996544, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001998848 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 22, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 28, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 6, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 21, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 27, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 6, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 18, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 26, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 8, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 117332, 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 324812800 2024-09-21T00:48:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 4, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.774 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.775 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.776 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:07 smithi016 ceph-mon[30947]: pgmap v405: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 MiB/s rd, 619 KiB/s wr, 257 op/s 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.779 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.780 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.781 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.782 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.783 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 0, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-21T00:48:07.784 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 70, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:07.785 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:07.786 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:07.787 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 237671, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 71, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 151, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:07.788 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 89969, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 372, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 38, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 11332, 2024-09-21T00:48:07.789 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 33, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 38, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 38, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.229994555, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006052488 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 38, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 60 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 38, 2024-09-21T00:48:07.790 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 38, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 10, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 3, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 6, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 6, 2024-09-21T00:48:07.791 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 20, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:07.792 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T00:48:07.793 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 75, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 14, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 1 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-21T00:48:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:07.795 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 495, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 625696, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 495, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 495, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 625696, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:07.796 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 38, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 11332, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 38, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 11332, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.797 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 38, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 38, 2024-09-21T00:48:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 38, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 38, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:07.799 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55e9724111e0": { 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:07.800 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 4, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1120, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 4, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1120, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T00:48:07.801 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:07.802 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T00:48:07.802 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:07 smithi178 ceph-mon[34888]: pgmap v405: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 MiB/s rd, 619 KiB/s wr, 257 op/s 2024-09-21T00:48:08.660 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T00:48:08.735 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T00:48:08.735 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T00:48:08.735 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=15 2024-09-21T00:48:08.735 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T00:48:08.735 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T00:48:08.984 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:48:09.498 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 46, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 50, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 25035, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 54445, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 14, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.010611766, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.002230014, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.006398063, 2024-09-21T00:48:09.499 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000504017, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 46, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.024975197, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000542939 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 44, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000009020, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000205 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 736 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.500 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 319, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 297, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 112423, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 288682, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 12, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 8, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.044746461, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.021033164, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.023476006, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.001634788, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 298, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.028416756, 2024-09-21T00:48:09.501 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000095358 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 522, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000118226, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000226 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 172352 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 135, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 123, 2024-09-21T00:48:09.502 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 548944, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 91406, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.023305432, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.008122157, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.021100563, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000330016, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 122, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.025575517, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000209635 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 19, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000004556, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000239 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 537152, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 48096 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:09.504 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 44, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.001354278, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000030779 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000022047, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000011023 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.505 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 11, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T00:48:09.506 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 18, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 2, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 16, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 13, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 8, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 3, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 9, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 6, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 3, 2024-09-21T00:48:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 4, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 234, 2024-09-21T00:48:09.508 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:09.509 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 15, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 9, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 10, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:09.510 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:09.511 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 4, 2024-09-21T00:48:09.512 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 4, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 2, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 2, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4195424, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-21T00:48:09.513 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.005907272, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001969090 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 22, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 28, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 6, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 21, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 27, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 6, 2024-09-21T00:48:09.514 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 18, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 26, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 8, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 117028, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 324812800 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 4, 2024-09-21T00:48:09.515 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.517 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.518 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.519 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.520 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.522 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.523 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.524 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T00:48:09.525 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.526 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T00:48:09.527 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 72, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:09.528 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:09.529 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:09.530 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 254375, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 86, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 151, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:09.531 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 89969, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 372, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 38, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 11332, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 27, 2024-09-21T00:48:09.532 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 38, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 38, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.251994041, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006631422 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 38, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 60 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 38, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 0, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 38, 2024-09-21T00:48:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 10, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 3, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 6, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 6, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:09.534 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 20, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T00:48:09.535 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 75, 2024-09-21T00:48:09.536 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 9, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 9, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 14, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 1 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T00:48:09.537 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:09.538 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 496, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 632896, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 496, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 496, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 632896, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:09.539 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 38, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 11332, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 38, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 11332, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.540 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 38, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 38, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 38, 2024-09-21T00:48:09.541 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 38, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:09.542 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x560a7b6576c0": { 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:09.543 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 4, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1120, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 4, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1120, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:09.544 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T00:48:09.545 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T00:48:09.545 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:09.545 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T00:48:09.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:09 smithi016 ceph-mon[30947]: pgmap v406: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 55 KiB/s wr, 71 op/s 2024-09-21T00:48:09.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:09 smithi123 ceph-mon[34853]: pgmap v406: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 55 KiB/s wr, 71 op/s 2024-09-21T00:48:09.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:09 smithi178 ceph-mon[34888]: pgmap v406: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 55 KiB/s wr, 71 op/s 2024-09-21T00:48:10.353 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T00:48:10.354 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T00:48:10.354 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T00:48:10.354 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=15 2024-09-21T00:48:10.354 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T00:48:10.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T00:48:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 309, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 305, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 585696, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 117734, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.051449613, 2024-09-21T00:48:11.148 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.024200298, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.021889422, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.007230800, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 304, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.017019999, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000055986 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 511440, 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 47456 2024-09-21T00:48:11.149 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 60, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 716, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 173306, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.005616576, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.003435780, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.001480169, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000061098, 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:11.150 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 58, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.004137196, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000071330 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 172608 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 376, 2024-09-21T00:48:11.151 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 376, 2024-09-21T00:48:11.152 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 99805, 2024-09-21T00:48:11.152 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 118751, 2024-09-21T00:48:11.152 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:11.152 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-21T00:48:11.152 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.032560345, 2024-09-21T00:48:11.153 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.012210807, 2024-09-21T00:48:11.153 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.009275143, 2024-09-21T00:48:11.153 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.009293100, 2024-09-21T00:48:11.153 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 375, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.018004050, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000048010 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T00:48:11.154 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1038, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.028696763, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000027646 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.155 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 1, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-09-21T00:48:11.157 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-21T00:48:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:11.159 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-21T00:48:11.160 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T00:48:11.161 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.162 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 4, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 2, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T00:48:11.163 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4195424, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 4195283, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 4 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 3, 2024-09-21T00:48:11.164 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 3, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 1, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 1, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 116652, 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 315371520 2024-09-21T00:48:11.165 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T00:48:11.166 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T00:48:11.167 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:11.169 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.172 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.174 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.175 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.176 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.177 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.178 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 0, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 1321, 2024-09-21T00:48:11.179 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:11.180 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:11.181 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 181159, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 44, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:11.182 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 151, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 8672, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 13, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:11.183 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 595, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 21, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 3, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 595, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 595, 2024-09-21T00:48:11.184 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.307992680, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000517634 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 595, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 596 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 595, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 595, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 366, 2024-09-21T00:48:11.185 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 227, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 1, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-09-21T00:48:11.186 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T00:48:11.187 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 75, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 4, 2024-09-21T00:48:11.188 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 4, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 684, 2024-09-21T00:48:11.190 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 617171, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 684, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 684, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 617171, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:11.191 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 595, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1125, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 595, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1125, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.192 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 595, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 595, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 595, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 595, 2024-09-21T00:48:11.193 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:11.194 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x556977bb5450": { 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T00:48:11.195 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T00:48:11.196 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T00:48:11.197 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T00:48:11.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:11 smithi016 ceph-mon[30947]: pgmap v407: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 36 op/s 2024-09-21T00:48:11.769 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:11 smithi123 ceph-mon[34853]: pgmap v407: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 36 op/s 2024-09-21T00:48:11.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:11 smithi178 ceph-mon[34888]: pgmap v407: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 36 op/s 2024-09-21T00:48:11.928 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T00:48:11.929 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T00:48:11.929 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T00:48:11.929 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T00:48:11.929 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T00:48:11.929 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T00:48:12.190 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:12.791 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 40, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 42, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 23468, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 51380, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.010162326, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.001639328, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.006120051, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000473506, 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:12.792 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 40, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.017228177, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000430704 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 44, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000008629, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000196 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 736 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 312, 2024-09-21T00:48:12.793 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 293, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 111003, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 294544, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 12, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.035766754, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.016020226, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.018186774, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.002097734, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 291, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.025733629, 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000088431 2024-09-21T00:48:12.794 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 517, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000105007, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000203 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 172080 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 148, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 140, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 539710, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 92400, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 9, 2024-09-21T00:48:12.795 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.024109898, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.008050941, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.021705201, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000387136, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 140, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.027982852, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000199877 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 20, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000004964, 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000248 2024-09-21T00:48:12.796 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 526064, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 50784 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 47, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001601775, 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000034080 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.797 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000025107, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000012553 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.798 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 11, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 18, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 2, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 16, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 13, 2024-09-21T00:48:12.799 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 8, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 3, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 10, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 6, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 4, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-21T00:48:12.800 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 4, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 234, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:12.801 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-21T00:48:12.802 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 17, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 10, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 10, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:12.803 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_started": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_write_failed": 0 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-21T00:48:12.804 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 4, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 4, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 2, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-09-21T00:48:12.805 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195424, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.006048589, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002016196 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 22, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 28, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 6, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 21, 2024-09-21T00:48:12.806 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 27, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 6, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 18, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 26, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 8, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 117832, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 324804608 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:12.807 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 4, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:12.808 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:12.809 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.810 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.811 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.812 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.813 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.814 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.815 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.816 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.817 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:12.818 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 0, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 1, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 0, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-21T00:48:12.819 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 70, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:12.820 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:12.821 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 229681, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 71, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:12.822 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 151, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 89969, 2024-09-21T00:48:12.823 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 372, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 38, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 11332, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 33, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 38, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 38, 2024-09-21T00:48:12.824 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.231995730, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.006105150 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 38, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 60 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 38, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 0, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 38, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-09-21T00:48:12.825 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 10, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 3, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 6, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 6, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 0, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 20, 2024-09-21T00:48:12.826 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-21T00:48:12.827 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 75, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-09-21T00:48:12.828 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 9, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 9, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 14, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 1 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-21T00:48:12.829 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 496, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 620567, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:12.830 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 496, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 496, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 620567, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:12.831 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 38, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 11332, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 38, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 11332, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.832 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 38, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 38, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 38, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 38, 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:12.833 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:12.834 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5602f6507380": { 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 4, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1120, 2024-09-21T00:48:12.835 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 4, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1120, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "trackedop": { 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:12.836 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-21T00:48:13.599 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T00:48:13.599 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T00:48:13.599 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T00:48:13.600 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=17 2024-09-21T00:48:13.600 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T00:48:13.600 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:13 smithi016 ceph-mon[30947]: pgmap v408: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-21T00:48:13.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:13 smithi123 ceph-mon[34853]: pgmap v408: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-21T00:48:13.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:13 smithi178 ceph-mon[34888]: pgmap v408: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-21T00:48:13.859 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:14.390 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-21T00:48:14.390 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:14.390 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 462, 2024-09-21T00:48:14.390 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 462, 2024-09-21T00:48:14.390 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4333919, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 146102, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.055690917, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.022188143, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.015977475, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.013065519, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 461, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.020730724, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000044969 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.391 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 56, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 111, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4193403, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 191444, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-09-21T00:48:14.392 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.012904447, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.005940393, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.004509534, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.001468954, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 109, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.009879182, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000090634 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 173888 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 293, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 289, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4756235, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 111845, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 3, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.042754836, 2024-09-21T00:48:14.394 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.016639697, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.023034497, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.006977976, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 288, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.012060571, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000041876 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 511056, 2024-09-21T00:48:14.395 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 46336 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1172, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.036022142, 2024-09-21T00:48:14.396 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000030735 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-09-21T00:48:14.397 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 1235, 2024-09-21T00:48:14.398 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 786, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 449, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 112, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 2, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:14.399 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 4, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 234, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-21T00:48:14.400 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:14.401 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:14.402 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:14.403 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_started": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_write_failed": 0 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 6120, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-21T00:48:14.404 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 3, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 9, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 16674349, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 16761585, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 16759088, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.405 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 6120 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 23, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 1235, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 1212, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 18, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 24, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 6, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 1235, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 1242, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 7, 2024-09-21T00:48:14.406 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 118744, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 320786432 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.407 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.408 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-21T00:48:14.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.410 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.412 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-21T00:48:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.414 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.416 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.417 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.418 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 1427, 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:14.419 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:14.420 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:14.421 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 189279, 2024-09-21T00:48:14.422 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 49, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 151, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:14.423 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 915594, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 5289, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 719, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 26, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 4, 2024-09-21T00:48:14.424 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 719, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 719, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.373993051, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000520157 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 719, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 720 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 719, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 719, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-21T00:48:14.425 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 446, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 270, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 2, 2024-09-21T00:48:14.426 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-21T00:48:14.427 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 75, 2024-09-21T00:48:14.428 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 5, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 5, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-21T00:48:14.429 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:14.430 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 807, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 13203499, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 807, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 807, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 13203499, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.431 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 719, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 12567291, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 719, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 12567291, 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:14.432 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 719, 2024-09-21T00:48:14.433 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 719, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 719, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 719, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:14.434 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.435 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55d05e491450": { 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:14.436 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: "trackedop": { 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:14.437 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-21T00:48:15.195 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T00:48:15.195 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T00:48:15.195 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T00:48:15.195 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T00:48:15.195 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T00:48:15.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T00:48:15.446 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:15.537 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:15 smithi178 ceph-mon[34888]: pgmap v409: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-21T00:48:15.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:15 smithi016 ceph-mon[30947]: pgmap v409: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-21T00:48:15.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:15 smithi123 ceph-mon[34853]: pgmap v409: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 330, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 257, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 115708, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 129418, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 7, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.036221028, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.013721471, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.019988979, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.001913099, 2024-09-21T00:48:15.965 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 256, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.031492173, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000123016 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 528, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000110500, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000209 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:15.966 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 140, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 130, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 546957, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 70919, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 7, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.021315056, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.008202345, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.017978594, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000411151, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 129, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.019963088, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000154752 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.967 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 18, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000006625, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000368 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 533888, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 49536 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 33, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 87, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 21407, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 246774, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 13, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-09-21T00:48:15.968 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.012492819, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.004864179, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.006768807, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000192058, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 85, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.013687407, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000161028 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 46, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000008266, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000179 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.969 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 175360 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 34, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001903761, 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000055992 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:15.970 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000016952, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000008476 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 1, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.971 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 1, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 11, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 18, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 2, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 16, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 13, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 8, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:15.972 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 3, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 11, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 6, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 1, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 4, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-21T00:48:15.973 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 4, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 234, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 17, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 10, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 10, 2024-09-21T00:48:15.975 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:15.976 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_started": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_write_failed": 0 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 3, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 3, 2024-09-21T00:48:15.977 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 2, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195200, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.004593851, 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002296925 2024-09-21T00:48:15.978 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 22, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 28, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 6, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 21, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 27, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 6, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 18, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 26, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 8, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-21T00:48:15.979 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 120356, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 324812800 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 1, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 1, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 2, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.981 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.982 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.983 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.984 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.985 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.986 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.987 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.988 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.989 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-09-21T00:48:15.990 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 1, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 119, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:15.991 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:15.992 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:15.993 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 230567, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 80, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:15.994 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 151, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 89993, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 375, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-21T00:48:15.995 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 37, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 11108, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 28, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 37, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 37, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.217995976, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.005891783 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 37, 2024-09-21T00:48:15.996 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 59 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 37, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 37, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 10, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 2, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 6, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-21T00:48:15.997 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 6, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 20, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-21T00:48:15.998 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-21T00:48:15.999 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 75, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 8, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 8, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 14, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-09-21T00:48:16.000 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 1 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:16.001 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 499, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 630408, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 499, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 499, 2024-09-21T00:48:16.002 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 630408, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 37, 2024-09-21T00:48:16.003 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 11108, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 37, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 11108, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:16.004 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 37, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 37, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 37, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 37, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:16.005 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x559957763450": { 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:16.006 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 896, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 896, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:16.007 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.008 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:16.008 INFO:teuthology.orchestra.run.smithi178.stdout: "trackedop": { 2024-09-21T00:48:16.008 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-21T00:48:16.008 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:16.008 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-21T00:48:16.831 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T00:48:16.832 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T00:48:16.832 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-21T00:48:16.832 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=17 2024-09-21T00:48:16.832 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T00:48:16.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T00:48:17.081 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:48:17.522 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:17 smithi178 ceph-mon[34888]: pgmap v410: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 232, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 234, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 62287, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 73840, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 2, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.025482641, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.010494997, 2024-09-21T00:48:17.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.006075243, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.006114651, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 232, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.009440399, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000040691 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T00:48:17.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 220, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 214, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 545994, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 89257, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.032411015, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.012020493, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.020917814, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.004458515, 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:17.645 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 214, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.014228912, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000066490 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 514976, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 49184 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 228, 2024-09-21T00:48:17.646 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 287, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 76432, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 246794, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.038025506, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.018118408, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.008236824, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.008540355, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 285, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.016941693, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000059444 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-21T00:48:17.647 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 174608 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1027, 2024-09-21T00:48:17.648 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.032157820, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000031312 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-21T00:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 0, 2024-09-21T00:48:17.650 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 1, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-21T00:48:17.651 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T00:48:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-21T00:48:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-21T00:48:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0, 2024-09-21T00:48:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_started": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_succeeded": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "uninline_write_failed": 0 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 3, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-21T00:48:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195200, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 4194892, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 3 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 3, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 3, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 0, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 1, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 1, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 0, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 0, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 0, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 0, 2024-09-21T00:48:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 116404, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 315371520 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-21T00:48:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-21T00:48:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-21T00:48:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 1, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 0, 2024-09-21T00:48:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 1432, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-21T00:48:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T00:48:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T00:48:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 189239, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 48, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7312, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 151, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-21T00:48:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 8672, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 13, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 585, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2024-09-21T00:48:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 585, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 585, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.282994742, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000483751 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 585, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 586 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 585, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 585, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-21T00:48:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 351, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 232, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2024-09-21T00:48:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-21T00:48:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 75, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-09-21T00:48:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 5, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 5, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-21T00:48:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 676, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 616283, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 676, 2024-09-21T00:48:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 676, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 616283, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 585, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 901, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 585, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 901, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 585, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 585, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 585, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 585, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x559b6cccf380": { 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-21T00:48:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "trackedop": { 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-21T00:48:17.688 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-21T00:48:17.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:17 smithi016 ceph-mon[30947]: pgmap v410: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2024-09-21T00:48:17.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:17 smithi123 ceph-mon[34853]: pgmap v410: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2024-09-21T00:48:18.475 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T00:48:18.475 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T00:48:18.475 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T00:48:18.475 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T00:48:18.475 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T00:48:18.485 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T00:48:18.485 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:48:18.485 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:48:18.507 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-21T00:48:18.507 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:48:18.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T00:48:18.880 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:19.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 -- 172.21.15.16:0/2119732408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc103170 msgr2=0x7f8bdc1076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:19.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 --2- 172.21.15.16:0/2119732408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc103170 0x7f8bdc1076a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009900 tx=0x7f8bcc02a410 comp rx=0 tx=0).stop 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 -- 172.21.15.16:0/2119732408 shutdown_connections 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 --2- 172.21.15.16:0/2119732408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 --2- 172.21.15.16:0/2119732408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc103170 0x7f8bdc1076a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 --2- 172.21.15.16:0/2119732408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc102820 0x7f8bdc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.417+0000 7f8be3cca640 1 -- 172.21.15.16:0/2119732408 >> 172.21.15.16:0/2119732408 conn(0x7f8bdc079760 msgr2=0x7f8bdc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 -- 172.21.15.16:0/2119732408 shutdown_connections 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 -- 172.21.15.16:0/2119732408 wait complete. 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 Processor -- start 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 -- start start 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 0x7f8bdc1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.418+0000 7f8be3cca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc103170 0x7f8bdc1a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be3cca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:19.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be3cca640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc11a060 con 0x7f8bdc107c30 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be3cca640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc119ee0 con 0x7f8bdc103170 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be3cca640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc11a1e0 con 0x7f8bdc102820 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48162/0 (socket says 172.21.15.16:48162) 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 -- 172.21.15.16:0/1198382654 learned_addr learned my addr 172.21.15.16:0/1198382654 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be1a66640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 0x7f8bdc1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be1265640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc103170 0x7f8bdc1a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 -- 172.21.15.16:0/1198382654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 msgr2=0x7f8bdc1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 0x7f8bdc1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 -- 172.21.15.16:0/1198382654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc103170 msgr2=0x7f8bdc1a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:19.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc103170 0x7f8bdc1a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 -- 172.21.15.16:0/1198382654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc1a6a20 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be1a66640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 0x7f8bdc1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be2267640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400eaa0 tx=0x7f8bd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400cdb0 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd4005020 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40116d0 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.419+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc1a6d10 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.420+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc1ad470 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.421+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc06c1f0 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.422+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8bd40051d0 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.423+0000 7f8bd2ffd640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 0x7f8bc80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.423+0000 7f8be1a66640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 0x7f8bc80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.423+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f8bd40e74d0 con 0x7f8bdc107c30 2024-09-21T00:48:19.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.424+0000 7f8be1a66640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 0x7f8bc80b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc06c8f0 tx=0x7f8bd800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:19.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.427+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bd4016030 con 0x7f8bdc107c30 2024-09-21T00:48:19.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.627+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8bdc1a1be0 con 0x7f8bdc107c30 2024-09-21T00:48:19.628 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:19 smithi016 ceph-mon[30947]: pgmap v411: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.627+0000 7f8bd2ffd640 1 -- 172.21.15.16:0/1198382654 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v75) ==== 81+0+592 (secure 0 0 0) 0x7f8bd40addf0 con 0x7f8bdc107c30 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/2300615142 2024-09-22T00:36:46.160526+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/2300615142 2024-09-22T00:36:46.160526+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2443520683 2024-09-22T00:36:46.160526+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1457328245 2024-09-22T00:36:46.160526+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/4012921169 2024-09-22T00:36:46.160526+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1347629010 2024-09-22T00:36:19.833384+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3084433609 2024-09-22T00:36:19.833384+0000 2024-09-21T00:48:19.629 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3616915113 2024-09-22T00:36:19.833384+0000 2024-09-21T00:48:19.630 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3616915113 2024-09-22T00:36:19.833384+0000 2024-09-21T00:48:19.630 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2138679085 2024-09-22T00:36:19.833384+0000 2024-09-21T00:48:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:listed 10 entries 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 msgr2=0x7f8bc80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 0x7f8bc80b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc06c8f0 tx=0x7f8bd800a560 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 msgr2=0x7f8bdc1a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400eaa0 tx=0x7f8bd400ef60 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 shutdown_connections 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f8bc80b6510 0x7f8bc80b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bdc107c30 0x7f8bdc1a62f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bdc103170 0x7f8bdc1a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 --2- 172.21.15.16:0/1198382654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bdc102820 0x7f8bdc1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 >> 172.21.15.16:0/1198382654 conn(0x7f8bdc079760 msgr2=0x7f8bdc105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:19.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 shutdown_connections 2024-09-21T00:48:19.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:19.630+0000 7f8be3cca640 1 -- 172.21.15.16:0/1198382654 wait complete. 2024-09-21T00:48:19.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:19 smithi123 ceph-mon[34853]: pgmap v411: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:48:19.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:19 smithi178 ceph-mon[34888]: pgmap v411: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T00:48:20.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T00:48:20.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:48:20.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T00:48:20.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:48:20.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:48:20.385 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T00:48:20.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:48:20.422 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-21T00:48:20.478 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T00:48:20.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:48:20.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:48:20.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:48:20.546 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-09-21T00:48:20.554 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:20 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/1198382654' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T00:48:20.607 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T00:48:20.617 INFO:tasks.cephadm:Teardown begin 2024-09-21T00:48:20.617 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T00:48:20.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:48:20.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:20 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/1198382654' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T00:48:20.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:20 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/1198382654' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T00:48:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:21.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 -- 172.21.15.16:0/665146695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c10e5c0 msgr2=0x7f455c10e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 --2- 172.21.15.16:0/665146695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c10e5c0 0x7f455c10e9d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f454c009900 tx=0x7f454c02a410 comp rx=0 tx=0).stop 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 -- 172.21.15.16:0/665146695 shutdown_connections 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 --2- 172.21.15.16:0/665146695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c114800 0x7f455c11b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 --2- 172.21.15.16:0/665146695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 0x7f455c1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 --2- 172.21.15.16:0/665146695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c10e5c0 0x7f455c10e9d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 -- 172.21.15.16:0/665146695 >> 172.21.15.16:0/665146695 conn(0x7f455c10a3c0 msgr2=0x7f455c10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:21.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 -- 172.21.15.16:0/665146695 shutdown_connections 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.401+0000 7f4561a62640 1 -- 172.21.15.16:0/665146695 wait complete. 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.402+0000 7f4561a62640 1 Processor -- start 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.402+0000 7f4561a62640 1 -- start start 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c10e5c0 0x7f455c1a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 0x7f455c1a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f455c11e4d0 con 0x7f455c114800 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f455c11e350 con 0x7f455c10e5c0 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f4561a62640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f455c11e650 con 0x7f455c113eb0 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48176/0 (socket says 172.21.15.16:48176) 2024-09-21T00:48:21.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 -- 172.21.15.16:0/9470162 learned_addr learned my addr 172.21.15.16:0/9470162 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455affd640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 0x7f455c1a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455b7fe640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c10e5c0 0x7f455c1a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 -- 172.21.15.16:0/9470162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 msgr2=0x7f455c1a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 0x7f455c1a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 -- 172.21.15.16:0/9470162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c10e5c0 msgr2=0x7f455c1a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c10e5c0 0x7f455c1a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 -- 172.21.15.16:0/9470162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c1aae30 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.403+0000 7f455bfff640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f455400eaa0 tx=0x7f455400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.404+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455400cdb0 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.404+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1ab120 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.404+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4554005020 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.404+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45540116d0 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.404+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1b1880 con 0x7f455c114800 2024-09-21T00:48:21.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.405+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c10e9d0 con 0x7f455c114800 2024-09-21T00:48:21.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.407+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f45540051d0 con 0x7f455c114800 2024-09-21T00:48:21.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.408+0000 7f4558ff9640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 0x7f45440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:21.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.408+0000 7f455b7fe640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 0x7f45440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:21.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.408+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f45540e7420 con 0x7f455c114800 2024-09-21T00:48:21.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.409+0000 7f455b7fe640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 0x7f45440b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f454c031440 tx=0x7f454c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:21.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.415+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4554016030 con 0x7f455c114800 2024-09-21T00:48:21.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.639+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f455c02e640 con 0x7f455c114800 2024-09-21T00:48:21.640 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:21 smithi016 ceph-mon[30947]: pgmap v412: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:48:21.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.639+0000 7f4558ff9640 1 -- 172.21.15.16:0/9470162 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f45540add40 con 0x7f455c114800 2024-09-21T00:48:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:48:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:48:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 msgr2=0x7f45440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 0x7f45440b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f454c031440 tx=0x7f454c005d50 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 msgr2=0x7f455c1aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f455400eaa0 tx=0x7f455400ef60 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 shutdown_connections 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f45440b6510 0x7f45440b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f455c114800 0x7f455c1aa700 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f455c113eb0 0x7f455c1a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 --2- 172.21.15.16:0/9470162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455c10e5c0 0x7f455c1a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 >> 172.21.15.16:0/9470162 conn(0x7f455c10a3c0 msgr2=0x7f455c113500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:21.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 shutdown_connections 2024-09-21T00:48:21.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:21.642+0000 7f4561a62640 1 -- 172.21.15.16:0/9470162 wait complete. 2024-09-21T00:48:21.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:21 smithi123 ceph-mon[34853]: pgmap v412: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:48:21.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:21 smithi178 ceph-mon[34888]: pgmap v412: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T00:48:22.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:48:22.633 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:22.754 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:22 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/9470162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:22.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:22 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/9470162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:22.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:22 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/9470162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:23.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 -- 172.21.15.16:0/3547173804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248108cf0 msgr2=0x7fe24810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:23.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 --2- 172.21.15.16:0/3547173804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248108cf0 0x7fe24810f520 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe240009ca0 tx=0x7fe24002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 -- 172.21.15.16:0/3547173804 shutdown_connections 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 --2- 172.21.15.16:0/3547173804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248108cf0 0x7fe24810f520 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 --2- 172.21.15.16:0/3547173804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe2481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 --2- 172.21.15.16:0/3547173804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248102a60 0x7fe248102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 -- 172.21.15.16:0/3547173804 >> 172.21.15.16:0/3547173804 conn(0x7fe248079730 msgr2=0x7fe248079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 -- 172.21.15.16:0/3547173804 shutdown_connections 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.161+0000 7fe24f074640 1 -- 172.21.15.16:0/3547173804 wait complete. 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 Processor -- start 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 -- start start 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:23.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe24819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 0x7fe24819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe248113a80 con 0x7fe248102a60 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe248113900 con 0x7fe2481083a0 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24f074640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe248113c00 con 0x7fe248108cf0 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.162+0000 7fe24ce10640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48192/0 (socket says 172.21.15.16:48192) 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 -- 172.21.15.16:0/4264768901 learned_addr learned my addr 172.21.15.16:0/4264768901 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe247fff640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe24819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24d611640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 0x7fe24819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 -- 172.21.15.16:0/4264768901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 msgr2=0x7fe24819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 0x7fe24819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 -- 172.21.15.16:0/4264768901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 msgr2=0x7fe24819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe24819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 -- 172.21.15.16:0/4264768901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2481a0400 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe247fff640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe24819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24d611640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 0x7fe24819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24ce10640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c970 tx=0x7fe23800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238007bb0 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe238007d50 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2481a06f0 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.163+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23800f450 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.164+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2481a6e50 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.164+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe248102e70 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.166+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe238004f00 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.167+0000 7fe245ffb640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 0x7fe2300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.167+0000 7fe247fff640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 0x7fe2300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.167+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7fe2380e73f0 con 0x7fe248102a60 2024-09-21T00:48:23.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.167+0000 7fe247fff640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 0x7fe2300b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe23c005e00 tx=0x7fe23c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:23.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.170+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe238014030 con 0x7fe248102a60 2024-09-21T00:48:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.397+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe24819b5c0 con 0x7fe248102a60 2024-09-21T00:48:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.397+0000 7fe245ffb640 1 -- 172.21.15.16:0/4264768901 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fe2380add10 con 0x7fe248102a60 2024-09-21T00:48:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:48:23.399 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-09-21T00:46:15:355323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4060683495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4060683495},{"type":"v1","addr":"172.21.15.16:6835","nonce":4060683495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/220014269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":220014269},{"type":"v1","addr":"172.21.15.16:6837","nonce":220014269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:44:18.388808+0000","modified":"2024-09-21T00:46:14.368092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24677,"mds_1":24644,"mds_2":24625,"mds_3":24620,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14778":{"gid":14778,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6839/3052513368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":3052513368},{"type":"v1","addr":"172.21.15.16:6839","nonce":3052513368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14790":{"gid":14790,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6841/1186818130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":1186818130},{"type":"v1","addr":"172.21.15.16:6841","nonce":1186818130}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/2278158780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2278158780},{"type":"v1","addr":"172.21.15.178:6833","nonce":2278158780}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6833/2611682237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2611682237},{"type":"v1","addr":"172.21.15.123:6833","nonce":2611682237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4194574330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4194574330},{"type":"v1","addr":"172.21.15.178:6835","nonce":4194574330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6837/795211231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":795211231},{"type":"v1","addr":"172.21.15.178:6837","nonce":795211231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.123:6835/1315446944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1315446944},{"type":"v1","addr":"172.21.15.123:6835","nonce":1315446944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.178:6839/3738575776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3738575776},{"type":"v1","addr":"172.21.15.178:6839","nonce":3738575776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24644":{"gid":24644,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.123:6837/2648060982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2648060982},{"type":"v1","addr":"172.21.15.123:6837","nonce":2648060982}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24677":{"gid":24677,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/760564744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":760564744},{"type":"v1","addr":"172.21.15.123:6839","nonce":760564744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24677,"qdb_cluster":[24613,24620,24625,24677,24644]},"id":1}]} 2024-09-21T00:48:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 msgr2=0x7fe2300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 0x7fe2300b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe23c005e00 tx=0x7fe23c005c70 comp rx=0 tx=0).stop 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 msgr2=0x7fe24819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c970 tx=0x7fe23800ce30 comp rx=0 tx=0).stop 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 shutdown_connections 2024-09-21T00:48:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fe2300b6510 0x7fe2300b8a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe248108cf0 0x7fe24819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2481083a0 0x7fe24819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 --2- 172.21.15.16:0/4264768901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe248102a60 0x7fe24819a490 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 >> 172.21.15.16:0/4264768901 conn(0x7fe248079730 msgr2=0x7fe248104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 shutdown_connections 2024-09-21T00:48:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:23.400+0000 7fe24f074640 1 -- 172.21.15.16:0/4264768901 wait complete. 2024-09-21T00:48:23.731 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:23 smithi016 ceph-mon[30947]: pgmap v413: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:48:23.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:23 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/4264768901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:23.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:23 smithi123 ceph-mon[34853]: pgmap v413: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:48:23.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:23 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/4264768901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:23.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:23 smithi178 ceph-mon[34888]: pgmap v413: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-21T00:48:23.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:23 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/4264768901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:48:24.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:48:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- 172.21.15.16:0/3688719258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c1083c0 msgr2=0x7f9f6c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 --2- 172.21.15.16:0/3688719258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c1087d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009900 tx=0x7f9f6002a410 comp rx=0 tx=0).stop 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- 172.21.15.16:0/3688719258 shutdown_connections 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 --2- 172.21.15.16:0/3688719258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c108d10 0x7f9f6c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 --2- 172.21.15.16:0/3688719258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c1087d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 --2- 172.21.15.16:0/3688719258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 0x7f9f6c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- 172.21.15.16:0/3688719258 >> 172.21.15.16:0/3688719258 conn(0x7f9f6c079740 msgr2=0x7f9f6c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- 172.21.15.16:0/3688719258 shutdown_connections 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- 172.21.15.16:0/3688719258 wait complete. 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 Processor -- start 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.794+0000 7f9f727d6640 1 -- start start 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 0x7f9f6c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:24.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c112980 con 0x7f9f6c108d10 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c112800 con 0x7f9f6c1083c0 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f727d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c112b00 con 0x7f9f6c102a80 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45722/0 (socket says 172.21.15.16:45722) 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 -- 172.21.15.16:0/823068901 learned_addr learned my addr 172.21.15.16:0/823068901 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f6b7fe640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f6bfff640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 0x7f9f6c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 -- 172.21.15.16:0/823068901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 msgr2=0x7f9f6c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 0x7f9f6c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 -- 172.21.15.16:0/823068901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c1083c0 msgr2=0x7f9f6c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.795+0000 7f9f70d73640 1 -- 172.21.15.16:0/823068901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c1a0490 con 0x7f9f6c108d10 2024-09-21T00:48:24.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f70d73640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009fd0 tx=0x7f9f6400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64017070 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f64003e20 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c1a0780 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64010460 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.796+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c1a6ee0 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.797+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6c103d00 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.798+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9f64003970 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.799+0000 7f9f697fa640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 0x7f9f540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.799+0000 7f9f6bfff640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 0x7f9f540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.799+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7f9f640e6f40 con 0x7f9f6c108d10 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.800+0000 7f9f6bfff640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 0x7f9f540b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:24.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.802+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f640ad860 con 0x7f9f6c108d10 2024-09-21T00:48:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.990+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f6c1a70b0 con 0x7f9f6c108d10 2024-09-21T00:48:24.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.992+0000 7f9f697fa640 1 -- 172.21.15.16:0/823068901 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22650 (secure 0 0 0) 0x7f9f640b1c40 con 0x7f9f6c108d10 2024-09-21T00:48:24.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-21T00:48:24.995 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"49060640-77b1-11ef-baf5-efdc52797490","created":"2024-09-21T00:35:57.524731+0000","modified":"2024-09-21T00:44:47.793517+0000","last_up_change":"2024-09-21T00:43:26.741076+0000","last_in_change":"2024-09-21T00:43:03.688490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:39:36.636978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:44:14.364094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:44:16.243088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5583349e-c367-4589-b3a7-a3912bb27cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6803","nonce":1318446246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6805","nonce":1318446246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6809","nonce":1318446246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1318446246},{"type":"v1","addr":"172.21.15.16:6807","nonce":1318446246}]},"public_addr":"172.21.15.16:6803/1318446246","cluster_addr":"172.21.15.16:6805/1318446246","heartbeat_back_addr":"172.21.15.16:6809/1318446246","heartbeat_front_addr":"172.21.15.16:6807/1318446246","state":["exists","up"]},{"osd":1,"uuid":"999bcbd3-bb63-4e7c-b2e7-e41b2fb218df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6801","nonce":2399482563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6803","nonce":2399482563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6807","nonce":2399482563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2399482563},{"type":"v1","addr":"172.21.15.123:6805","nonce":2399482563}]},"public_addr":"172.21.15.123:6801/2399482563","cluster_addr":"172.21.15.123:6803/2399482563","heartbeat_back_addr":"172.21.15.123:6807/2399482563","heartbeat_front_addr":"172.21.15.123:6805/2399482563","state":["exists","up"]},{"osd":2,"uuid":"b09b9ef0-4e02-4df8-9e16-876c52c027c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6801","nonce":231892136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6803","nonce":231892136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6807","nonce":231892136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":231892136},{"type":"v1","addr":"172.21.15.178:6805","nonce":231892136}]},"public_addr":"172.21.15.178:6801/231892136","cluster_addr":"172.21.15.178:6803/231892136","heartbeat_back_addr":"172.21.15.178:6807/231892136","heartbeat_front_addr":"172.21.15.178:6805/231892136","state":["exists","up"]},{"osd":3,"uuid":"dda541c6-f1c3-40b9-8101-307d46151404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6811","nonce":1166375609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6813","nonce":1166375609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6817","nonce":1166375609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":1166375609},{"type":"v1","addr":"172.21.15.16:6815","nonce":1166375609}]},"public_addr":"172.21.15.16:6811/1166375609","cluster_addr":"172.21.15.16:6813/1166375609","heartbeat_back_addr":"172.21.15.16:6817/1166375609","heartbeat_front_addr":"172.21.15.16:6815/1166375609","state":["exists","up"]},{"osd":4,"uuid":"fb5b7ffd-58b4-4b23-9233-9821e51ddf23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6809","nonce":1012246785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6811","nonce":1012246785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6815","nonce":1012246785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1012246785},{"type":"v1","addr":"172.21.15.123:6813","nonce":1012246785}]},"public_addr":"172.21.15.123:6809/1012246785","cluster_addr":"172.21.15.123:6811/1012246785","heartbeat_back_addr":"172.21.15.123:6815/1012246785","heartbeat_front_addr":"172.21.15.123:6813/1012246785","state":["exists","up"]},{"osd":5,"uuid":"468ee4cb-31d6-402a-8d52-add13aaef32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6809","nonce":1751898506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6811","nonce":1751898506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6815","nonce":1751898506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1751898506},{"type":"v1","addr":"172.21.15.178:6813","nonce":1751898506}]},"public_addr":"172.21.15.178:6809/1751898506","cluster_addr":"172.21.15.178:6811/1751898506","heartbeat_back_addr":"172.21.15.178:6815/1751898506","heartbeat_front_addr":"172.21.15.178:6813/1751898506","state":["exists","up"]},{"osd":6,"uuid":"8f6ffe0c-1477-4a08-9609-e7c559dfe280","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6819","nonce":562709826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6821","nonce":562709826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6825","nonce":562709826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":562709826},{"type":"v1","addr":"172.21.15.16:6823","nonce":562709826}]},"public_addr":"172.21.15.16:6819/562709826","cluster_addr":"172.21.15.16:6821/562709826","heartbeat_back_addr":"172.21.15.16:6825/562709826","heartbeat_front_addr":"172.21.15.16:6823/562709826","state":["exists","up"]},{"osd":7,"uuid":"4555d360-ad10-49c0-9972-1b7b0ddde002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6817","nonce":2228888488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6819","nonce":2228888488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6823","nonce":2228888488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2228888488},{"type":"v1","addr":"172.21.15.123:6821","nonce":2228888488}]},"public_addr":"172.21.15.123:6817/2228888488","cluster_addr":"172.21.15.123:6819/2228888488","heartbeat_back_addr":"172.21.15.123:6823/2228888488","heartbeat_front_addr":"172.21.15.123:6821/2228888488","state":["exists","up"]},{"osd":8,"uuid":"70b08292-671a-4458-91a5-c07975068f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6817","nonce":3499718195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6819","nonce":3499718195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6823","nonce":3499718195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3499718195},{"type":"v1","addr":"172.21.15.178:6821","nonce":3499718195}]},"public_addr":"172.21.15.178:6817/3499718195","cluster_addr":"172.21.15.178:6819/3499718195","heartbeat_back_addr":"172.21.15.178:6823/3499718195","heartbeat_front_addr":"172.21.15.178:6821/3499718195","state":["exists","up"]},{"osd":9,"uuid":"32770935-de25-4c09-b1dc-98c5aa14468f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6827","nonce":726892379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6829","nonce":726892379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6833","nonce":726892379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":726892379},{"type":"v1","addr":"172.21.15.16:6831","nonce":726892379}]},"public_addr":"172.21.15.16:6827/726892379","cluster_addr":"172.21.15.16:6829/726892379","heartbeat_back_addr":"172.21.15.16:6833/726892379","heartbeat_front_addr":"172.21.15.16:6831/726892379","state":["exists","up"]},{"osd":10,"uuid":"05aa564e-f675-4b5a-8acd-7324f35b015a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6825","nonce":2298127239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6827","nonce":2298127239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6831","nonce":2298127239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2298127239},{"type":"v1","addr":"172.21.15.123:6829","nonce":2298127239}]},"public_addr":"172.21.15.123:6825/2298127239","cluster_addr":"172.21.15.123:6827/2298127239","heartbeat_back_addr":"172.21.15.123:6831/2298127239","heartbeat_front_addr":"172.21.15.123:6829/2298127239","state":["exists","up"]},{"osd":11,"uuid":"6769ceec-1b7b-4c94-a9e6-e8780afda9ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6825","nonce":2747266489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6827","nonce":2747266489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6831","nonce":2747266489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2747266489},{"type":"v1","addr":"172.21.15.178:6829","nonce":2747266489}]},"public_addr":"172.21.15.178:6825/2747266489","cluster_addr":"172.21.15.178:6827/2747266489","heartbeat_back_addr":"172.21.15.178:6831/2747266489","heartbeat_front_addr":"172.21.15.178:6829/2747266489","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:38:42.237452+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:07.532263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:32.983804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:39:58.678371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:24.148467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:40:50.658623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:17.057454+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:41:43.274232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:08.711000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:33.626746+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:42:59.971219+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:43:25.100951+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:6800/2300615142":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/2443520683":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1457328245":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/4012921169":"2024-09-22T00:36:46.160526+0000","172.21.15.16:0/1347629010":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/3084433609":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6801/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:6800/3616915113":"2024-09-22T00:36:19.833384+0000","172.21.15.16:0/2138679085":"2024-09-22T00:36:19.833384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 msgr2=0x7f9f540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 0x7f9f540b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c005850 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 msgr2=0x7f9f6c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009fd0 tx=0x7f9f6400b260 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 shutdown_connections 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7f9f540b6510 0x7f9f540b8a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6c108d10 0x7f9f6c19fd60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f6c1083c0 0x7f9f6c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 --2- 172.21.15.16:0/823068901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f6c102a80 0x7f9f6c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:24.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 >> 172.21.15.16:0/823068901 conn(0x7f9f6c079740 msgr2=0x7f9f6c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:24.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 shutdown_connections 2024-09-21T00:48:24.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:24.995+0000 7f9f727d6640 1 -- 172.21.15.16:0/823068901 wait complete. 2024-09-21T00:48:25.742 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:25 smithi016 ceph-mon[30947]: pgmap v414: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:48:25.743 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:25 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/823068901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:48:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:25 smithi123 ceph-mon[34853]: pgmap v414: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:48:25.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:25 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/823068901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:48:25.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T00:48:25.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:25 smithi178 ceph-mon[34888]: pgmap v414: 97 pgs: 97 active+clean; 4.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T00:48:25.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:25 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/823068901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:48:26.031 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:26.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 -- 172.21.15.16:0/4071198672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0108d10 msgr2=0x7faed010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:26.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 --2- 172.21.15.16:0/4071198672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0108d10 0x7faed010f540 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7faec8009ca0 tx=0x7faec802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 -- 172.21.15.16:0/4071198672 shutdown_connections 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 --2- 172.21.15.16:0/4071198672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0108d10 0x7faed010f540 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 --2- 172.21.15.16:0/4071198672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 0x7faed01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 --2- 172.21.15.16:0/4071198672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0102a80 0x7faed0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 -- 172.21.15.16:0/4071198672 >> 172.21.15.16:0/4071198672 conn(0x7faed0079740 msgr2=0x7faed0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 -- 172.21.15.16:0/4071198672 shutdown_connections 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.606+0000 7faed57a0640 1 -- 172.21.15.16:0/4071198672 wait complete. 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 Processor -- start 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 -- start start 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 0x7faed0199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0108d10 0x7faed0199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faed0112980 con 0x7faed0102a80 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faed0112800 con 0x7faed0108d10 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.607+0000 7faed57a0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faed0112b00 con 0x7faed01083c0 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45742/0 (socket says 172.21.15.16:45742) 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 -- 172.21.15.16:0/2693223916 learned_addr learned my addr 172.21.15.16:0/2693223916 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faece7fc640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 0x7faed0199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faecf7fe640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0108d10 0x7faed0199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 -- 172.21.15.16:0/2693223916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 msgr2=0x7faed0199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 0x7faed0199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 -- 172.21.15.16:0/2693223916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0108d10 msgr2=0x7faed0199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0108d10 0x7faed0199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 -- 172.21.15.16:0/2693223916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01a86c0 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faeceffd640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faec000d950 tx=0x7faec000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0017070 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01a8950 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec000de80 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec000f620 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.608+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a8ee0 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.609+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed0103d00 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.611+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7faec0009c30 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.612+0000 7faec7fff640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 0x7faebc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.612+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8161+0+0 (secure 0 0 0) 0x7faec00e6e70 con 0x7faed0102a80 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.612+0000 7faece7fc640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 0x7faebc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.612+0000 7faece7fc640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 0x7faebc0b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed006b200 tx=0x7faeb800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.615+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faec00ad790 con 0x7faed0102a80 2024-09-21T00:48:26.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.843+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faed0102e90 con 0x7faed0102a80 2024-09-21T00:48:26.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.845+0000 7faec7fff640 1 -- 172.21.15.16:0/2693223916 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7faec00b1b70 con 0x7faed0102a80 2024-09-21T00:48:26.846 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T00:48:26.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.849+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 msgr2=0x7faebc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:26.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.849+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 0x7faebc0b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed006b200 tx=0x7faeb800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.849+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 msgr2=0x7faed0199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:26.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.849+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faec000d950 tx=0x7faec000dd50 comp rx=0 tx=0).stop 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 shutdown_connections 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7faebc0b6510 0x7faebc0b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed0108d10 0x7faed0199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed01083c0 0x7faed0199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 --2- 172.21.15.16:0/2693223916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faed0102a80 0x7faed0199040 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 >> 172.21.15.16:0/2693223916 conn(0x7faed0079740 msgr2=0x7faed01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 shutdown_connections 2024-09-21T00:48:26.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:26.850+0000 7faed57a0640 1 -- 172.21.15.16:0/2693223916 wait complete. 2024-09-21T00:48:27.200 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a[30943]: 2024-09-21T00:48:26.843+0000 7f23865f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-mds[72417]: -- 172.21.15.16:0/1837955320 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be7c7df860 con 0x55be80987180 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: starting mds.a at 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-mds[72035]: -- 172.21.15.16:0/2116627478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aca29ffc20 con 0x55aca6ba7600 2024-09-21T00:48:27.201 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:48:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: starting mds.g at 2024-09-21T00:48:27.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-mds[63237]: -- 172.21.15.123:0/3091499229 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561896a45860 con 0x56189abed600 2024-09-21T00:48:27.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: starting mds.b at 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-mds[62683]: -- 172.21.15.123:0/208815001 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55667edb5860 con 0x556682f5d180 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: starting mds.e at 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-mds[62953]: -- 172.21.15.123:0/1816072173 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561039737860 con 0x56103d8df180 2024-09-21T00:48:27.271 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: starting mds.h at 2024-09-21T00:48:27.272 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k[62410]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.272 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k[62410]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.272 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-mds[62414]: -- 172.21.15.123:0/4232991523 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a375703860 con 0x55a3798ab180 2024-09-21T00:48:27.272 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:48:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k[62410]: starting mds.k at 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-mds[64229]: -- 172.21.15.178:0/1692179149 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56205a4e1860 con 0x56205e689600 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: starting mds.i at 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.287 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-mds[63691]: -- 172.21.15.178:0/1998338540 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b5e3b1860 con 0x557b62559600 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: starting mds.f at 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c[63955]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c[63955]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-mds[63959]: -- 172.21.15.178:0/370659472 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55660abc9860 con 0x55660ed71180 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c[63955]: starting mds.c at 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:27.288 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-mds[63422]: -- 172.21.15.178:0/1654758797 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562dc8e0b860 con 0x562dccfb3180 2024-09-21T00:48:27.289 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:48:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: starting mds.l at 2024-09-21T00:48:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T00:48:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T00:48:27.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T00:48:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:48:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T00:48:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:48:27.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:27 smithi016 ceph-mon[30947]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T00:48:27.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T00:48:27.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:48:27.771 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:27 smithi123 ceph-mon[34853]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: pgmap v415: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/2693223916' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:48:27.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:27 smithi178 ceph-mon[34888]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T00:48:27.908 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:28.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 -- 172.21.15.16:0/2499351813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3201094a0 msgr2=0x7fc3201098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:28.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 --2- 172.21.15.16:0/2499351813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3201094a0 0x7fc3201098b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc310009900 tx=0x7fc31002a410 comp rx=0 tx=0).stop 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 -- 172.21.15.16:0/2499351813 shutdown_connections 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 --2- 172.21.15.16:0/2499351813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320109df0 0x7fc320110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 --2- 172.21.15.16:0/2499351813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3201094a0 0x7fc3201098b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 --2- 172.21.15.16:0/2499351813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc320103b60 0x7fc320103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 -- 172.21.15.16:0/2499351813 >> 172.21.15.16:0/2499351813 conn(0x7fc32007b850 msgr2=0x7fc32007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 -- 172.21.15.16:0/2499351813 shutdown_connections 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.399+0000 7fc327a08640 1 -- 172.21.15.16:0/2499351813 wait complete. 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 Processor -- start 2024-09-21T00:48:28.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 -- start start 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320103b60 0x7fc32019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3201094a0 0x7fc32019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc320113af0 con 0x7fc320109df0 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc320113970 con 0x7fc320103b60 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc327a08640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc320113c70 con 0x7fc3201094a0 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.400+0000 7fc325fa5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45796/0 (socket says 172.21.15.16:45796) 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 -- 172.21.15.16:0/873968952 learned_addr learned my addr 172.21.15.16:0/873968952 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc3257a4640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320103b60 0x7fc32019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc324fa3640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3201094a0 0x7fc32019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 -- 172.21.15.16:0/873968952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3201094a0 msgr2=0x7fc32019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3201094a0 0x7fc32019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 -- 172.21.15.16:0/873968952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320103b60 msgr2=0x7fc32019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320103b60 0x7fc32019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 -- 172.21.15.16:0/873968952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3201a0450 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc325fa5640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b970 tx=0x7fc31800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318019070 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc318014440 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3201a0740 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180075d0 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.401+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3201a6ea0 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.403+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc320103f70 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.404+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc31801c070 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.405+0000 7fc3167fc640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 0x7fc30c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.405+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8591+0+0 (secure 0 0 0) 0x7fc3180e6910 con 0x7fc320109df0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.405+0000 7fc3257a4640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 0x7fc30c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:28.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.405+0000 7fc3257a4640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 0x7fc30c0b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:28.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.409+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3180b1420 con 0x7fc320109df0 2024-09-21T00:48:28.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.637+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc32010b650 con 0x7fc320109df0 2024-09-21T00:48:28.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.851+0000 7fc3167fc640 1 -- 172.21.15.16:0/873968952 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fc3180b6360 con 0x7fc320109df0 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 msgr2=0x7fc30c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 0x7fc30c0b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c00b390 comp rx=0 tx=0).stop 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 msgr2=0x7fc32019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b970 tx=0x7fc31800be30 comp rx=0 tx=0).stop 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 shutdown_connections 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fc30c0b6510 0x7fc30c0b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320109df0 0x7fc32019fd20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3201094a0 0x7fc32019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 --2- 172.21.15.16:0/873968952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc320103b60 0x7fc32019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:28.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 >> 172.21.15.16:0/873968952 conn(0x7fc32007b850 msgr2=0x7fc3201054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:28.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 shutdown_connections 2024-09-21T00:48:28.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:28.855+0000 7fc327a08640 1 -- 172.21.15.16:0/873968952 wait complete. 2024-09-21T00:48:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6839/3085970200,v1:172.21.15.16:6841/3085970200] up:boot 2024-09-21T00:48:29.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6832/2938850125,v1:172.21.15.123:6833/2938850125] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.16:6838/3981552585,v1:172.21.15.16:6840/3981552585] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6832/2543101619,v1:172.21.15.178:6834/2543101619] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6833/1702906836,v1:172.21.15.178:6835/1702906836] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6834/1064237608,v1:172.21.15.123:6835/1064237608] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6836/686747198,v1:172.21.15.178:6838/686747198] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.178:6837/2773290969,v1:172.21.15.178:6839/2773290969] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6836/2182672168,v1:172.21.15.123:6837/2182672168] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: mds.? [v2:172.21.15.123:6838/1340783501,v1:172.21.15.123:6839/1340783501] up:boot 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:48:29.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:48:29.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:28 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6839/3085970200,v1:172.21.15.16:6841/3085970200] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6832/2938850125,v1:172.21.15.123:6833/2938850125] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.16:6838/3981552585,v1:172.21.15.16:6840/3981552585] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6832/2543101619,v1:172.21.15.178:6834/2543101619] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6833/1702906836,v1:172.21.15.178:6835/1702906836] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6834/1064237608,v1:172.21.15.123:6835/1064237608] up:boot 2024-09-21T00:48:29.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6836/686747198,v1:172.21.15.178:6838/686747198] up:boot 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.178:6837/2773290969,v1:172.21.15.178:6839/2773290969] up:boot 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6836/2182672168,v1:172.21.15.123:6837/2182672168] up:boot 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: mds.? [v2:172.21.15.123:6838/1340783501,v1:172.21.15.123:6839/1340783501] up:boot 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:48:29.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:48:29.272 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:28 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6839/3085970200,v1:172.21.15.16:6841/3085970200] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6832/2938850125,v1:172.21.15.123:6833/2938850125] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.16:6838/3981552585,v1:172.21.15.16:6840/3981552585] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6832/2543101619,v1:172.21.15.178:6834/2543101619] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6833/1702906836,v1:172.21.15.178:6835/1702906836] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6834/1064237608,v1:172.21.15.123:6835/1064237608] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6836/686747198,v1:172.21.15.178:6838/686747198] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.178:6837/2773290969,v1:172.21.15.178:6839/2773290969] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6836/2182672168,v1:172.21.15.123:6837/2182672168] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: mds.? [v2:172.21.15.123:6838/1340783501,v1:172.21.15.123:6839/1340783501] up:boot 2024-09-21T00:48:29.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:48:29.288 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:28 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:48:29.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T00:48:29.980 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: pgmap v417: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: Cluster is now healthy 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:48:30.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: fsmap 12 up:standby 2024-09-21T00:48:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:30.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:29 smithi016 ceph-mon[30947]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: pgmap v417: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: Cluster is now healthy 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: fsmap 12 up:standby 2024-09-21T00:48:30.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:30.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:30.271 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:29 smithi123 ceph-mon[34853]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: pgmap v417: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 409 B/s wr, 10 op/s 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: Cluster is now healthy 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/873968952' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: fsmap 12 up:standby 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:48:30.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:29 smithi178 ceph-mon[34888]: from='mgr.14152 172.21.15.16:0/613885410' entity='mgr.x' 2024-09-21T00:48:30.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 -- 172.21.15.16:0/1619725732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac1083d0 msgr2=0x7fabac1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 --2- 172.21.15.16:0/1619725732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac1083d0 0x7fabac1087e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faba0009900 tx=0x7faba002a410 comp rx=0 tx=0).stop 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 -- 172.21.15.16:0/1619725732 shutdown_connections 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 --2- 172.21.15.16:0/1619725732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac108d20 0x7fabac10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 --2- 172.21.15.16:0/1619725732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac1083d0 0x7fabac1087e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 --2- 172.21.15.16:0/1619725732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac102ae0 0x7fabac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 -- 172.21.15.16:0/1619725732 >> 172.21.15.16:0/1619725732 conn(0x7fabac0797b0 msgr2=0x7fabac079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 -- 172.21.15.16:0/1619725732 shutdown_connections 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.564+0000 7fabb1a39640 1 -- 172.21.15.16:0/1619725732 wait complete. 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 Processor -- start 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 -- start start 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1083d0 0x7fabac0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac108d20 0x7fabac1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1129e0 con 0x7fabac102ae0 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fabac112860 con 0x7fabac1083d0 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabb1a39640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fabac112b60 con 0x7fabac108d20 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.565+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45810/0 (socket says 172.21.15.16:45810) 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 -- 172.21.15.16:0/3951027863 learned_addr learned my addr 172.21.15.16:0/3951027863 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaa7fc640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1083d0 0x7fabac0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabab7fe640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac108d20 0x7fabac1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 -- 172.21.15.16:0/3951027863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac108d20 msgr2=0x7fabac1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac108d20 0x7fabac1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 -- 172.21.15.16:0/3951027863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1083d0 msgr2=0x7fabac0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1083d0 0x7fabac0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 -- 172.21.15.16:0/3951027863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac1a8780 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabaaffd640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c970 tx=0x7fab9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c007bb0 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac1a8a70 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9c007d50 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00f450 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.566+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1a8f30 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.567+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac102ef0 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.569+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fab9c004f00 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.570+0000 7fabb0a37640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 0x7fab940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.570+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8591+0+0 (secure 0 0 0) 0x7fab9c0e7560 con 0x7fabac102ae0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.570+0000 7fabaa7fc640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 0x7fab940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.570+0000 7fabaa7fc640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 0x7fab940b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faba0009230 tx=0x7faba0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.573+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab9c014030 con 0x7fabac102ae0 2024-09-21T00:48:30.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.764+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fabac100970 con 0x7fabac102ae0 2024-09-21T00:48:30.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.858+0000 7fabb0a37640 1 -- 172.21.15.16:0/3951027863 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7fab9c0adc90 con 0x7fabac102ae0 2024-09-21T00:48:30.859 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 msgr2=0x7fab940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 0x7fab940b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faba0009230 tx=0x7faba0031400 comp rx=0 tx=0).stop 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 msgr2=0x7fabac0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c970 tx=0x7fab9c00ce30 comp rx=0 tx=0).stop 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 shutdown_connections 2024-09-21T00:48:30.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fab940b6510 0x7fab940b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac108d20 0x7fabac1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabac1083d0 0x7fabac0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 --2- 172.21.15.16:0/3951027863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac102ae0 0x7fabac0ff670 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 >> 172.21.15.16:0/3951027863 conn(0x7fabac0797b0 msgr2=0x7fabac101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 shutdown_connections 2024-09-21T00:48:30.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:30.862+0000 7fabb1a39640 1 -- 172.21.15.16:0/3951027863 wait complete. 2024-09-21T00:48:31.171 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:30 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:31.222 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:30 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:31.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:30 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:31.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 49060640-77b1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T00:48:31.899 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:48:32.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:31 smithi016 ceph-mon[30947]: pgmap v418: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 9 op/s 2024-09-21T00:48:32.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:31 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:32.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:31 smithi016 ceph-mon[30947]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:48:32.195 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:31 smithi123 ceph-mon[34853]: pgmap v418: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 9 op/s 2024-09-21T00:48:32.196 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:31 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:32.196 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:31 smithi123 ceph-mon[34853]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:48:32.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:31 smithi178 ceph-mon[34888]: pgmap v418: 97 pgs: 97 active+clean; 4.7 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 9 op/s 2024-09-21T00:48:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:31 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/3951027863' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:32.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:31 smithi178 ceph-mon[34888]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:48:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 -- 172.21.15.16:0/1695915373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc103b60 msgr2=0x7fbebc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 --2- 172.21.15.16:0/1695915373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc103b60 0x7fbebc103f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009ca0 tx=0x7fbeac02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 -- 172.21.15.16:0/1695915373 shutdown_connections 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 --2- 172.21.15.16:0/1695915373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 0x7fbebc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 --2- 172.21.15.16:0/1695915373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc1094a0 0x7fbebc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 --2- 172.21.15.16:0/1695915373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc103b60 0x7fbebc103f70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 -- 172.21.15.16:0/1695915373 >> 172.21.15.16:0/1695915373 conn(0x7fbebc07b850 msgr2=0x7fbebc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.432+0000 7fbec1729640 1 -- 172.21.15.16:0/1695915373 shutdown_connections 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.433+0000 7fbec1729640 1 -- 172.21.15.16:0/1695915373 wait complete. 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.433+0000 7fbec1729640 1 Processor -- start 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 -- start start 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 0x7fbebc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 0x7fbebc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc113ab0 con 0x7fbebc1094a0 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc113930 con 0x7fbebc103b60 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbec1729640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc113c30 con 0x7fbebc109df0 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45826/0 (socket says 172.21.15.16:45826) 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbeba7fc640 1 -- 172.21.15.16:0/687118126 learned_addr learned my addr 172.21.15.16:0/687118126 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbebaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 0x7fbebc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.434+0000 7fbebb7fe640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 0x7fbebc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 -- 172.21.15.16:0/687118126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 msgr2=0x7fbebc19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 0x7fbebc19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 -- 172.21.15.16:0/687118126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 msgr2=0x7fbebc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 0x7fbebc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 -- 172.21.15.16:0/687118126 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc1a03f0 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbebaffd640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 0x7fbebc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbeba7fc640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000e9f0 tx=0x7fbeb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000ccc0 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeb00108e0 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbebc1a06e0 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0018860 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.435+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbebc1a6e40 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.436+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc103f70 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.438+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbeb0010430 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.439+0000 7fbea3fff640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 0x7fbea40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.439+0000 7fbebaffd640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 0x7fbea40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.439+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8058+0+0 (secure 0 0 0) 0x7fbeb00e7940 con 0x7fbebc1094a0 2024-09-21T00:48:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.439+0000 7fbebaffd640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 0x7fbea40b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbeac005e30 tx=0x7fbeac009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:48:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.442+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbeb00b2610 con 0x7fbebc1094a0 2024-09-21T00:48:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.634+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbebc19b5b0 con 0x7fbebc1094a0 2024-09-21T00:48:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.866+0000 7fbea3fff640 1 -- 172.21.15.16:0/687118126 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fbebc19b5b0 con 0x7fbebc1094a0 2024-09-21T00:48:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 msgr2=0x7fbea40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 0x7fbea40b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbeac005e30 tx=0x7fbeac009360 comp rx=0 tx=0).stop 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 msgr2=0x7fbebc19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000e9f0 tx=0x7fbeb000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 shutdown_connections 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:6800/4223283672,v1:172.21.15.16:6801/4223283672] conn(0x7fbea40b6590 0x7fbea40b8aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbebc109df0 0x7fbebc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbebc1094a0 0x7fbebc19aa20 secure :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000e9f0 tx=0x7fbeb000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 --2- 172.21.15.16:0/687118126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbebc103b60 0x7fbebc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:48:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 >> 172.21.15.16:0/687118126 conn(0x7fbebc07b850 msgr2=0x7fbebc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:48:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.870+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 shutdown_connections 2024-09-21T00:48:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-21T00:48:32.871+0000 7fbec1729640 1 -- 172.21.15.16:0/687118126 wait complete. 2024-09-21T00:48:33.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:32 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:33.223 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:32 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:33.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:32 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T00:48:33.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:33.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:33.610 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:33.636 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T00:48:33.637 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:48:33.652 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:48:33.668 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:48:33.693 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T00:48:33.693 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T00:48:33.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a 2024-09-21T00:48:33.868 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:33 smithi016 systemd[1]: Stopping Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:34.259 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:33 smithi016 ceph-mon[30947]: pgmap v420: 65 pgs: 65 active+clean; 577 KiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:48:34.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:33 smithi016 ceph-mon[30947]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:34.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:33 smithi016 ceph-mon[30947]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T00:48:34.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a[30943]: 2024-09-21T00:48:34.002+0000 7f238bdfd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:34.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a[30943]: 2024-09-21T00:48:34.002+0000 7f238bdfd640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T00:48:34.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 podman[89302]: 2024-09-21 00:48:34.084449587 +0000 UTC m=+0.196051792 container died 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-21T00:48:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:33 smithi123 ceph-mon[34853]: pgmap v420: 65 pgs: 65 active+clean; 577 KiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:48:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:33 smithi123 ceph-mon[34853]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:34.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:33 smithi123 ceph-mon[34853]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T00:48:34.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:33 smithi178 ceph-mon[34888]: pgmap v420: 65 pgs: 65 active+clean; 577 KiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:48:34.286 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:33 smithi178 ceph-mon[34888]: from='client.? 172.21.15.16:0/687118126' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:48:34.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:33 smithi178 ceph-mon[34888]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T00:48:34.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 podman[89302]: 2024-09-21 00:48:34.620542737 +0000 UTC m=+0.732144934 container cleanup 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:34.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 bash[89302]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a 2024-09-21T00:48:35.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T00:48:35.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:34 smithi016 podman[89316]: 2024-09-21 00:48:34.822507924 +0000 UTC m=+0.735610171 container remove 78519b76047585a3a2e262d71387bad16151fb523d1dd857b807084f4acc4106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T00:48:35.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:35 smithi016 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T00:48:35.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:35 smithi016 systemd[1]: Stopped Ceph mon.a for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:48:35.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 21 00:48:35 smithi016 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.a.service: Consumed 13.886s CPU time. 2024-09-21T00:48:35.098 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:35.098 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T00:48:35.098 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T00:48:35.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.b 2024-09-21T00:48:35.448 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 systemd[1]: Stopping Ceph mon.b for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-b[34849]: 2024-09-21T00:48:35.445+0000 7f5c988c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-b[34849]: 2024-09-21T00:48:35.445+0000 7f5c988c0640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T00:48:35.770 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 podman[65530]: 2024-09-21 00:48:35.517629843 +0000 UTC m=+0.217379040 container died 90362e7916a095a59af2fd99b190f9dcba32be9715e1a0168dab5a6aab89e02c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 podman[65530]: 2024-09-21 00:48:35.930019337 +0000 UTC m=+0.629768566 container cleanup 90362e7916a095a59af2fd99b190f9dcba32be9715e1a0168dab5a6aab89e02c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:36.270 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 00:48:35 smithi123 bash[65530]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-b 2024-09-21T00:48:36.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T00:48:36.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:36.542 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T00:48:36.542 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T00:48:36.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.c 2024-09-21T00:48:36.875 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:36 smithi178 systemd[1]: Stopping Ceph mon.c for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c[34884]: 2024-09-21T00:48:36.874+0000 7fa56f68c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c[34884]: 2024-09-21T00:48:36.874+0000 7fa56f68c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T00:48:37.287 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:37 smithi178 podman[66586]: 2024-09-21 00:48:37.099921873 +0000 UTC m=+0.349027520 container died dd9b5a929fa8412f4003a53b24cd7cfe8c494fe10b4a8f319811a6155ba2a1c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:48:37.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:37 smithi178 podman[66586]: 2024-09-21 00:48:37.584067478 +0000 UTC m=+0.833173118 container cleanup dd9b5a929fa8412f4003a53b24cd7cfe8c494fe10b4a8f319811a6155ba2a1c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:37.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Sep 21 00:48:37 smithi178 bash[66586]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mon-c 2024-09-21T00:48:38.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T00:48:38.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:38.064 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T00:48:38.064 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T00:48:38.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T00:48:38.415 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:48:38 smithi016 systemd[1]: Stopping Ceph mgr.x for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:38.677 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:48:38 smithi016 podman[89425]: 2024-09-21 00:48:38.41509402 +0000 UTC m=+0.147435254 container died f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True) 2024-09-21T00:48:39.009 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:48:38 smithi016 podman[89425]: 2024-09-21 00:48:38.893817055 +0000 UTC m=+0.626158331 container cleanup f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:39.009 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:48:38 smithi016 bash[89425]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x 2024-09-21T00:48:39.316 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 21 00:48:39 smithi016 podman[89437]: 2024-09-21 00:48:39.204079492 +0000 UTC m=+0.782812511 container remove f2d84b65d8c0f80037105a683160032394087990f0b907231516145f653d21dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T00:48:39.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T00:48:39.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:39.367 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T00:48:39.367 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T00:48:39.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y 2024-09-21T00:48:39.715 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:39 smithi123 systemd[1]: Stopping Ceph mgr.y for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:40.012 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:39 smithi123 podman[65654]: 2024-09-21 00:48:39.714400289 +0000 UTC m=+0.143976908 container died be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T00:48:40.270 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 podman[65654]: 2024-09-21 00:48:40.110907955 +0000 UTC m=+0.540484571 container cleanup be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T00:48:40.270 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 bash[65654]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y 2024-09-21T00:48:40.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T00:48:40.617 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 podman[65666]: 2024-09-21 00:48:40.346214821 +0000 UTC m=+0.626919144 container remove be5985bc1457a257c766701f076b1cbbaee2f271c03ac44644d54ca2bcf8c0f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T00:48:40.617 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T00:48:40.617 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T00:48:40.617 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 systemd[1]: Stopped Ceph mgr.y for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:48:40.617 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 00:48:40 smithi123 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.y.service: Consumed 6.676s CPU time. 2024-09-21T00:48:40.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:40.629 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T00:48:40.629 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T00:48:40.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z 2024-09-21T00:48:40.960 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:40 smithi178 systemd[1]: Stopping Ceph mgr.z for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:41.249 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:40 smithi178 podman[66710]: 2024-09-21 00:48:40.96046574 +0000 UTC m=+0.139779213 container died 039a0166570ac94e715e3f22be704ab1aabfdb9009202d9e453eb2b222a9029a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T00:48:41.537 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 podman[66710]: 2024-09-21 00:48:41.357247463 +0000 UTC m=+0.536560933 container cleanup 039a0166570ac94e715e3f22be704ab1aabfdb9009202d9e453eb2b222a9029a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-z, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T00:48:41.537 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 bash[66710]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-z 2024-09-21T00:48:41.788 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T00:48:41.809 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 podman[66722]: 2024-09-21 00:48:41.542329052 +0000 UTC m=+0.576426054 container remove 039a0166570ac94e715e3f22be704ab1aabfdb9009202d9e453eb2b222a9029a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T00:48:41.809 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T00:48:41.809 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z.service: Failed with result 'exit-code'. 2024-09-21T00:48:41.809 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 systemd[1]: Stopped Ceph mgr.z for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:48:41.809 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Sep 21 00:48:41 smithi178 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mgr.z.service: Consumed 6.610s CPU time. 2024-09-21T00:48:41.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:41.822 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T00:48:41.822 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T00:48:41.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.0 2024-09-21T00:48:42.009 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:41 smithi016 systemd[1]: Stopping Ceph osd.0 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:42.509 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:48:42.123+0000 7fd540831640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:42.510 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:48:42.123+0000 7fd540831640 -1 osd.0 78 *** Got signal Terminated *** 2024-09-21T00:48:42.510 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0[46877]: 2024-09-21T00:48:42.123+0000 7fd540831640 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:48:47.902 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:47 smithi016 podman[89556]: 2024-09-21 00:48:47.629847719 +0000 UTC m=+5.619260738 container died f267913b78dde47735c240355152c510297ba797f5998e0488c81013f1b59c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:48:48.259 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:48 smithi016 podman[89556]: 2024-09-21 00:48:48.049758402 +0000 UTC m=+6.039171414 container cleanup f267913b78dde47735c240355152c510297ba797f5998e0488c81013f1b59c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T00:48:48.259 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:48 smithi016 bash[89556]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0 2024-09-21T00:48:48.537 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:48 smithi016 podman[89572]: 2024-09-21 00:48:48.28509644 +0000 UTC m=+0.655346048 container remove f267913b78dde47735c240355152c510297ba797f5998e0488c81013f1b59c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:48.886 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:48 smithi016 podman[89663]: 2024-09-21 00:48:48.643887232 +0000 UTC m=+0.017151241 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:48:48.886 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:48 smithi016 podman[89663]: 2024-09-21 00:48:48.769390581 +0000 UTC m=+0.142654573 container create d11a060e557f3978e0e699dad7eff379a118046f22c929e098d90e0cfac5106e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T00:48:49.215 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:49 smithi016 podman[89663]: 2024-09-21 00:48:49.014002281 +0000 UTC m=+0.387266283 container init d11a060e557f3978e0e699dad7eff379a118046f22c929e098d90e0cfac5106e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:49.215 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:49 smithi016 podman[89663]: 2024-09-21 00:48:49.017533953 +0000 UTC m=+0.390797945 container start d11a060e557f3978e0e699dad7eff379a118046f22c929e098d90e0cfac5106e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T00:48:49.215 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:49 smithi016 podman[89663]: 2024-09-21 00:48:49.105549341 +0000 UTC m=+0.478813338 container attach d11a060e557f3978e0e699dad7eff379a118046f22c929e098d90e0cfac5106e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T00:48:49.510 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 21 00:48:49 smithi016 podman[89663]: 2024-09-21 00:48:49.215171059 +0000 UTC m=+0.588435068 container died d11a060e557f3978e0e699dad7eff379a118046f22c929e098d90e0cfac5106e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T00:48:49.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T00:48:49.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:49.899 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T00:48:49.899 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T00:48:49.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.1 2024-09-21T00:48:50.270 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:49 smithi123 systemd[1]: Stopping Ceph osd.1 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:50.770 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:48:50.474+0000 7f111eeaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:50.770 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:48:50.474+0000 7f111eeaa640 -1 osd.1 78 *** Got signal Terminated *** 2024-09-21T00:48:50.770 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1[38777]: 2024-09-21T00:48:50.474+0000 7f111eeaa640 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:48:56.270 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:55 smithi123 podman[65782]: 2024-09-21 00:48:55.974131639 +0000 UTC m=+5.885403691 container died 71ce5be3029c705ec761817afd6166b761f9865f752aa0027d9aa4c7b1681e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T00:48:56.684 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:56 smithi123 podman[65782]: 2024-09-21 00:48:56.474030463 +0000 UTC m=+6.385302515 container cleanup 71ce5be3029c705ec761817afd6166b761f9865f752aa0027d9aa4c7b1681e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:48:56.684 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:56 smithi123 bash[65782]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1 2024-09-21T00:48:57.020 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:56 smithi123 podman[65797]: 2024-09-21 00:48:56.684370882 +0000 UTC m=+0.703971624 container remove 71ce5be3029c705ec761817afd6166b761f9865f752aa0027d9aa4c7b1681e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:48:57.338 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:56.985728357 +0000 UTC m=+0.015835293 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:48:57.338 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:57.085025562 +0000 UTC m=+0.115132486 container create a9301afe3edd11ddbd5b62b702a7d09e3bdbf7ca8192704d8c85329922c22379 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T00:48:57.338 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:57.338131108 +0000 UTC m=+0.368238040 container init a9301afe3edd11ddbd5b62b702a7d09e3bdbf7ca8192704d8c85329922c22379 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:48:57.771 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:57.341982142 +0000 UTC m=+0.372089075 container start a9301afe3edd11ddbd5b62b702a7d09e3bdbf7ca8192704d8c85329922c22379 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:48:57.771 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:57.429433412 +0000 UTC m=+0.459540346 container attach a9301afe3edd11ddbd5b62b702a7d09e3bdbf7ca8192704d8c85329922c22379 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T00:48:57.771 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 00:48:57 smithi123 podman[65886]: 2024-09-21 00:48:57.530574296 +0000 UTC m=+0.560681233 container died a9301afe3edd11ddbd5b62b702a7d09e3bdbf7ca8192704d8c85329922c22379 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T00:48:58.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T00:48:58.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:48:58.262 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T00:48:58.262 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T00:48:58.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.2 2024-09-21T00:48:58.579 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:48:58 smithi178 systemd[1]: Stopping Ceph osd.2 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:48:59.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:48:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:48:58.578+0000 7f93e36af640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:59.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:48:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:48:58.578+0000 7f93e36af640 -1 osd.2 78 *** Got signal Terminated *** 2024-09-21T00:48:59.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:48:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2[39279]: 2024-09-21T00:48:58.578+0000 7f93e36af640 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:04.286 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:04 smithi178 podman[66833]: 2024-09-21 00:49:04.023993951 +0000 UTC m=+5.568672550 container died 9f2b8085076444e3991b33a9d44486b9df89ba19bbaa2956d5b2f01f2a644d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:49:05.036 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:04 smithi178 podman[66833]: 2024-09-21 00:49:04.653618415 +0000 UTC m=+6.198297012 container cleanup 9f2b8085076444e3991b33a9d44486b9df89ba19bbaa2956d5b2f01f2a644d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T00:49:05.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:04 smithi178 bash[66833]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2 2024-09-21T00:49:05.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:04 smithi178 podman[66848]: 2024-09-21 00:49:04.872057417 +0000 UTC m=+0.848120830 container remove 9f2b8085076444e3991b33a9d44486b9df89ba19bbaa2956d5b2f01f2a644d5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T00:49:05.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.17552981 +0000 UTC m=+0.015953221 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:05.537 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.31482209 +0000 UTC m=+0.155245569 container create f54e6118ea47892dcb84f4c1f7b3789135cff520589aacb4064aa94f4cc73269 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T00:49:06.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.576300676 +0000 UTC m=+0.416724083 container init f54e6118ea47892dcb84f4c1f7b3789135cff520589aacb4064aa94f4cc73269 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T00:49:06.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.57997263 +0000 UTC m=+0.420396037 container start f54e6118ea47892dcb84f4c1f7b3789135cff520589aacb4064aa94f4cc73269 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:49:06.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.676335599 +0000 UTC m=+0.516759013 container attach f54e6118ea47892dcb84f4c1f7b3789135cff520589aacb4064aa94f4cc73269 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T00:49:06.037 INFO:journalctl@ceph.osd.2.smithi178.stdout:Sep 21 00:49:05 smithi178 podman[66941]: 2024-09-21 00:49:05.771224332 +0000 UTC m=+0.611647736 container died f54e6118ea47892dcb84f4c1f7b3789135cff520589aacb4064aa94f4cc73269 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:49:06.492 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T00:49:06.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:06.531 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T00:49:06.531 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T00:49:06.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.3 2024-09-21T00:49:06.846 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:06 smithi016 systemd[1]: Stopping Ceph osd.3 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:07.259 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:06 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:06.845+0000 7f99f04e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:07.259 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:06 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:06.845+0000 7f99f04e0640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-21T00:49:07.259 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:06 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:06.845+0000 7f99f04e0640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:09.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:09.099+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:09.759 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:09 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:09.352+0000 7f99e8ac3640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.702992+0000 front 2024-09-21T00:48:46.703058+0000 (oldest deadline 2024-09-21T00:49:08.403101+0000) 2024-09-21T00:49:09.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:09 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:09.470+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:10.441 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:10.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:10.759 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:10 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:10.364+0000 7f99e8ac3640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.702992+0000 front 2024-09-21T00:48:46.703058+0000 (oldest deadline 2024-09-21T00:49:08.403101+0000) 2024-09-21T00:49:10.769 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:10 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:10.500+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:10.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:10.441+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:11.413 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:11.071+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:11.509 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:11 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3[52989]: 2024-09-21T00:49:11.346+0000 7f99e8ac3640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.702992+0000 front 2024-09-21T00:48:46.703058+0000 (oldest deadline 2024-09-21T00:49:08.403101+0000) 2024-09-21T00:49:11.509 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:11 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:11.117+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:11.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:11 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:11.464+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:11.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:11 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:11.398+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:11.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:11.413+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:12.435 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:12.099+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:12.509 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:12 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:12.151+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:12.509 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:12 smithi016 podman[89766]: 2024-09-21 00:49:12.390072026 +0000 UTC m=+5.655110204 container died 95f7217250a17891d2c552f3d6e60533fbda7d397f6e0f898dbaae0e4c651103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T00:49:12.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:12 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:12.439+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:12.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:12 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:12.439+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:12.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:12.435+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:12.947 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:12 smithi016 podman[89766]: 2024-09-21 00:49:12.8130782 +0000 UTC m=+6.078116381 container cleanup 95f7217250a17891d2c552f3d6e60533fbda7d397f6e0f898dbaae0e4c651103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T00:49:12.947 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:12 smithi016 bash[89766]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3 2024-09-21T00:49:13.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:12 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:12.945+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:13.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:13 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:13.170+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:13.259 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:12 smithi016 podman[89782]: 2024-09-21 00:49:12.998032734 +0000 UTC m=+0.603973620 container remove 95f7217250a17891d2c552f3d6e60533fbda7d397f6e0f898dbaae0e4c651103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T00:49:13.442 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:13.144+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:13.726 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.344833218 +0000 UTC m=+0.016323190 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:13.727 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.457335491 +0000 UTC m=+0.128825445 container create 3ebe2241989dc4a0671b868b19fd09c04f4e7d6cbfc21e34500a6f4183462d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T00:49:13.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:13 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:13.478+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:13.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:13 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:13.428+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:13.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:13.442+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:14.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:13 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:13.909+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:14.010 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.726665975 +0000 UTC m=+0.398155930 container init 3ebe2241989dc4a0671b868b19fd09c04f4e7d6cbfc21e34500a6f4183462d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:49:14.010 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.730213095 +0000 UTC m=+0.401703059 container start 3ebe2241989dc4a0671b868b19fd09c04f4e7d6cbfc21e34500a6f4183462d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:49:14.010 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.810013976 +0000 UTC m=+0.481503931 container attach 3ebe2241989dc4a0671b868b19fd09c04f4e7d6cbfc21e34500a6f4183462d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:49:14.010 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 21 00:49:13 smithi016 podman[89873]: 2024-09-21 00:49:13.926060505 +0000 UTC m=+0.597550460 container died 3ebe2241989dc4a0671b868b19fd09c04f4e7d6cbfc21e34500a6f4183462d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T00:49:14.480 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:14.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:14.509 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:14 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:14.200+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:14.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T00:49:14.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:14.649 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T00:49:14.649 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T00:49:14.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.4 2024-09-21T00:49:14.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:14 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:14.449+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:14.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:14 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:14.460+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:14.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:14 smithi123 systemd[1]: Stopping Ceph osd.4 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:14.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:14.479+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:15.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:14 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:14.957+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:15.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:15 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:15.163+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:15.270 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:14 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:14.968+0000 7fab8a4e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:15.270 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:14 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:14.968+0000 7fab8a4e7640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-21T00:49:15.270 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:14 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:14.968+0000 7fab8a4e7640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:15.472 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:15.178+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:15.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:15 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:15.481+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:15.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:15 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:15.491+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:15.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:15.471+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:16.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:15 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:15.964+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:16.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:16 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:16.165+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:16.504 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:16 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:16.172+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:16.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:16 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:16.503+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:16.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:16 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:16.461+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:16.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:16 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:16.461+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:16.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:16 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:16.503+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:17.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:17 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:17.130+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:17.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:16 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:16.973+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:17.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:16 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:16.973+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:17.525 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:17 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:17.142+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:17.525 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:17 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:17.142+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:17.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:17 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:17.484+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:17.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:17 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:17.460+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:17.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:17 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:17.438+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:17.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:17 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:17.438+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:17.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:17 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:17.525+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:17.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:17 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:17.525+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:18.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:17 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:17.932+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:18.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:17 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:17.932+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:18.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:18.086+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:18.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:18.086+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:18.489 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:18 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:18.318+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:18.490 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:18 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:18.150+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:18.490 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:18 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:18.150+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:18.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:18 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:18.490+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:18.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:18 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:18.425+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:18.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:18 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:18.441+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:18.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:18 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:18.441+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:18.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:18 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:18.489+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:18.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:18 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:18.489+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:19.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:18.973+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:19.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:18.973+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:19.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:19 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:19.079+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:19.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:19 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:19.079+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:19.471 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:19 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:19.366+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:19.471 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:19 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:19.141+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:19.471 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:19 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:19.141+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:19.770 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:19 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4[44911]: 2024-09-21T00:49:19.467+0000 7fab82aca640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.924843+0000 front 2024-09-21T00:48:46.924871+0000 (oldest deadline 2024-09-21T00:49:09.224977+0000) 2024-09-21T00:49:19.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:19 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:19.474+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:19.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:19 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:19.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:19.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:19 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:19.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:19.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:19 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:19.470+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:19.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:19 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:19.470+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:20.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:19 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:19.928+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:20.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:19 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:19.928+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:20.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:20 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:20.111+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:20.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:20 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:20.111+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:20.442 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:20 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:20.404+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:20.443 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:20 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:20.160+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:20.443 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:20 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:20.160+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:20.701 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:20 smithi123 podman[66000]: 2024-09-21 00:49:20.382840634 +0000 UTC m=+5.540057556 container died 3959561130ab815349290a8bab52176a36c9dc2a2239a0017b0df0196587be66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T00:49:20.701 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:20 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:20.427+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:20.702 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:20 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:20.444+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:20.702 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:20 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:20.444+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:20.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:20 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:20.440+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:20.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:20 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:20.440+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:21.020 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:20 smithi123 podman[66000]: 2024-09-21 00:49:20.902830302 +0000 UTC m=+6.060047210 container cleanup 3959561130ab815349290a8bab52176a36c9dc2a2239a0017b0df0196587be66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T00:49:21.020 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:20 smithi123 bash[66000]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4 2024-09-21T00:49:21.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:20 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:20.934+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:21.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:20 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:20.934+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:21.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:21 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:21.071+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:21.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:21 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:21.071+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:21.414 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66015]: 2024-09-21 00:49:21.112963007 +0000 UTC m=+0.729922754 container remove 3959561130ab815349290a8bab52176a36c9dc2a2239a0017b0df0196587be66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T00:49:21.476 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:21 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:21.411+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:21.476 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:21 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:21.178+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:21.476 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:21 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:21.178+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:21.687 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:21 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:21.412+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:21.688 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:21 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:21.413+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:21.688 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:21 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:21.413+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:21.688 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.419172167 +0000 UTC m=+0.016296650 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:21.688 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.555503264 +0000 UTC m=+0.152627786 container create a5432fcd279e024e5f0253f07401b302a1a2a5a68fd5a7cfca6b2cd9088a917f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:49:21.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:21 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:21.475+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:21.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:21 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:21.475+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:21.995 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.799629047 +0000 UTC m=+0.396753531 container init a5432fcd279e024e5f0253f07401b302a1a2a5a68fd5a7cfca6b2cd9088a917f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T00:49:21.995 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.802857612 +0000 UTC m=+0.399982098 container start a5432fcd279e024e5f0253f07401b302a1a2a5a68fd5a7cfca6b2cd9088a917f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T00:49:21.995 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.899666127 +0000 UTC m=+0.496790616 container attach a5432fcd279e024e5f0253f07401b302a1a2a5a68fd5a7cfca6b2cd9088a917f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:49:22.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:21 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:21.947+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:22.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:21 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:21.947+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:22.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:22 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:22.075+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:22.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:22 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:22.075+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:22.270 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 00:49:21 smithi123 podman[66104]: 2024-09-21 00:49:21.994811034 +0000 UTC m=+0.591935511 container died a5432fcd279e024e5f0253f07401b302a1a2a5a68fd5a7cfca6b2cd9088a917f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T00:49:22.417 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:22 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:22.146+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:22.417 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:22 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:22.146+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:22.662 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:22 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:22.373+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:22.662 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:22 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:22.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:22.662 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:22 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:22.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:22.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T00:49:22.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:22.727 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T00:49:22.727 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T00:49:22.727 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.5 2024-09-21T00:49:22.755 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:22 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:22.416+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:22.755 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:22 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:22.450+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:22.755 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:22 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:22.450+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:23.036 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:22 smithi178 systemd[1]: Stopping Ceph osd.5 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:23.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:22 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:22.962+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:23.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:22 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:22.962+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:23.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:23.030+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:23.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:23.030+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:23.443 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:23.191+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:23.443 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:23.191+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:23.443 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:23.040+0000 7fdef0778640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:23.443 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:23.040+0000 7fdef0778640 -1 osd.5 78 *** Got signal Terminated *** 2024-09-21T00:49:23.443 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:23.040+0000 7fdef0778640 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:23.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:23 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:23.373+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:23.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:23 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:23.357+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:23.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:23 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:23.357+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:23.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:23.442+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:23.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:23.457+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:23.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:23 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:23.457+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:24.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:23.964+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:24.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:23.964+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:24.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:24 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:24.019+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:24.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:24 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:24.019+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:24.458 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:24.411+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:24.459 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:24.411+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:24.459 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:24.194+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:24.459 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:24.194+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:24.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:24 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:24.419+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:24.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:24 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:24.419+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:24.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:24 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:24.363+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:24.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:24 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:24.363+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:24.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:24 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:24.457+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:25.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:25.000+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:25.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:25.000+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:25.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:25.038+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:25.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:25.038+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:25.433 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:25.146+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:25.433 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:25.146+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:25.433 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:25.365+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:25.433 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:25.365+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:25.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:25.458+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:25.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:25.458+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:25.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:25.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:25.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:25.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:25.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:25 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:25.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:25.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:25 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:25.432+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:26.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:26.033+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:26.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:26.033+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:26.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:25.957+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:26.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:25.957+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:26.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:25 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:25.957+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:26.391 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:26.134+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:26.392 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:26.134+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:26.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:26.508+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:26.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:26.508+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:26.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:26.353+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:26.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:26.353+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:26.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:26 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:26.353+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:26.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:26.390+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:26.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:26.390+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:26.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:26.479+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:26.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:26 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:26.479+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:27.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:26.916+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:27.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:26.916+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:27.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:26.916+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:27.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:27.046+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:27.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:27.046+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:27.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:27.046+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:27.409 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:27.125+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:27.409 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:27.125+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:27.409 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:27.125+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:27.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:27.507+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:27.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:27.507+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:27.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:27.345+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:27.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:27.345+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:27.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:27 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:27.345+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:27.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:27.408+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:44.882686+0000 front 2024-09-21T00:48:44.882808+0000 (oldest deadline 2024-09-21T00:49:10.182856+0000) 2024-09-21T00:49:27.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:27.408+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.883872+0000 front 2024-09-21T00:48:54.884086+0000 (oldest deadline 2024-09-21T00:49:16.583875+0000) 2024-09-21T00:49:27.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5[45726]: 2024-09-21T00:49:27.408+0000 7fdeecd63640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.385197+0000 front 2024-09-21T00:49:02.385179+0000 (oldest deadline 2024-09-21T00:49:26.485286+0000) 2024-09-21T00:49:27.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:27.441+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:27.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:27 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:27.441+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:28.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:27.893+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:28.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:27.893+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:28.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:27 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:27.893+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:28.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:28.068+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:28.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:28.068+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:28.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:28.068+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:28.483 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:28 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:28.086+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:28.483 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:28 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:28.086+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:28.483 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:28 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:28.086+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:28.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:28 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:28.480+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:28.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:28 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:28.480+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:28.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:28 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:28.339+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:28.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:28 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:28.339+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:28.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:28 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:28.339+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:28.787 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:28 smithi178 podman[67056]: 2024-09-21 00:49:28.527570778 +0000 UTC m=+5.604304131 container died 9c27f03b40e93a7202588c6cd3e4984a3e54915abb6e32498aa105ed7cabc3e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T00:49:28.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:28 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:28.481+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:28.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:28 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:28.481+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:29.119 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:28 smithi178 podman[67056]: 2024-09-21 00:49:28.925224784 +0000 UTC m=+6.001958133 container cleanup 9c27f03b40e93a7202588c6cd3e4984a3e54915abb6e32498aa105ed7cabc3e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T00:49:29.119 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:28 smithi178 bash[67056]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5 2024-09-21T00:49:29.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:28.912+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:29.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:28.912+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:29.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:28 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:28.912+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:29.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:29.049+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:29.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:29.049+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:29.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:29.049+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:29.464 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67072]: 2024-09-21 00:49:29.168526425 +0000 UTC m=+0.640398102 container remove 9c27f03b40e93a7202588c6cd3e4984a3e54915abb6e32498aa105ed7cabc3e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:49:29.464 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:29 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:29.118+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:29.464 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:29 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:29.118+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:29.465 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:29 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:29.118+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:29.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:29 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:29.440+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:29.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:29 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:29.440+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:29.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:29 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:29.350+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:29.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:29 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:29.350+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:29.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:29 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:29.350+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:29.780 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:29 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:29.463+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:29.780 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:29 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:29.463+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:29.781 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.39643828 +0000 UTC m=+0.015917401 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:29.781 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.519810745 +0000 UTC m=+0.139289895 container create 977a960d20d1f2291d8c066521b11db5dbfce40afbc8311dde720bf5cf86b40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T00:49:30.037 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.780725402 +0000 UTC m=+0.400204513 container init 977a960d20d1f2291d8c066521b11db5dbfce40afbc8311dde720bf5cf86b40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T00:49:30.037 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.784138456 +0000 UTC m=+0.403617564 container start 977a960d20d1f2291d8c066521b11db5dbfce40afbc8311dde720bf5cf86b40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T00:49:30.037 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.889205617 +0000 UTC m=+0.508684740 container attach 977a960d20d1f2291d8c066521b11db5dbfce40afbc8311dde720bf5cf86b40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T00:49:30.037 INFO:journalctl@ceph.osd.5.smithi178.stdout:Sep 21 00:49:29 smithi178 podman[67160]: 2024-09-21 00:49:29.979687049 +0000 UTC m=+0.599166169 container died 977a960d20d1f2291d8c066521b11db5dbfce40afbc8311dde720bf5cf86b40c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:49:30.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:29.864+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:30.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:29.864+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:30.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:29 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:29.864+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:30.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:30.053+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:30.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:30.053+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:30.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:30.053+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:30.437 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:30 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:30.121+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:30.438 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:30 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:30.121+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:30.438 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:30 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:30.121+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:30.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T00:49:30.690 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:30 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:30.436+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:30.690 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:30 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:30.436+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:30.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:30.691 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T00:49:30.692 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T00:49:30.692 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.6 2024-09-21T00:49:30.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:30 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:30.488+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:30.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:30 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:30.488+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:30.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:30 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:30.369+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:30.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:30 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:30.369+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:30.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:30 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:30.369+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:31.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:30 smithi016 systemd[1]: Stopping Ceph osd.6 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:31.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:30.851+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:31.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:30.851+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:31.010 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:30 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:30.851+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:31.010 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.008+0000 7fb97c622640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:31.408 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:31.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:31.408 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:31.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:31.408 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:31.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:31.509 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.008+0000 7fb97c622640 -1 osd.6 78 *** Got signal Terminated *** 2024-09-21T00:49:31.510 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.008+0000 7fb97c622640 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:31.510 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:31.040+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:31.510 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:31.040+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:31.510 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:31.040+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:31.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:31 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:31.461+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:31.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:31 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:31.461+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:31.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:31 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:31.337+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:31.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:31 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:31.337+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:31.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:31 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:31.337+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:31.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:31.407+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:31.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:31 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:31.407+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:32.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.882+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:32.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.882+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:32.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:31.882+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:32.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:32.039+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:32.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:32.039+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:32.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:32.039+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:32.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:32 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:32.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:32.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:32 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:32.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:32.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:32 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:32.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:32.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:32.496+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:32.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:32.496+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:32.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:32.366+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:32.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:32.366+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:32.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:32 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:32.366+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:32.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:32 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:32.447+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:32.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:32 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:32.447+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:33.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:32.886+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:33.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:32.886+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:33.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:32 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:32.886+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:33.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.022+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:33.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.022+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:33.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.022+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:33.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:33 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:33.405+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:33.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:33 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:33.405+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:33.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:33 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:33.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:33.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:33 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:33.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:33.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:33 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:33.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:33.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:33 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:33.521+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:33.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:33 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:33.521+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:33.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:33 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:33.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:33.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:33 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:33.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:33.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:33 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:33.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:34.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:33.930+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:34.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:33.930+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:34.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:33.930+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:34.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.981+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:34.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.981+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:34.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.981+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:34.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:33 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:33.981+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:34.439 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:34.430+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:34.439 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:34.430+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:34.439 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:34.184+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:34.439 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:34.184+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:34.439 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:34 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:34.184+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:34.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:34.501+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:34.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:34.501+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:34.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:34.420+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:34.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:34.420+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:34.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:34.420+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:35.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:34.933+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:35.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:34.933+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:35.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:34.933+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:35.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:34.938+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:35.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:34.938+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:35.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:34.938+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:35.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:34 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:34.938+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:35.424 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:35.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:35.424 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:35.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:35.424 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:35.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:35.675 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:35.423+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:35.675 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:35 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:35.423+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:35.456+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:35.456+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:35.456+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:35.459+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:35.459+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:35.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:35.459+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:35.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:35 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:35.459+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:36.259 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:35.960+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.784575+0000 front 2024-09-21T00:48:46.784550+0000 (oldest deadline 2024-09-21T00:49:12.585423+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:35.960+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.687027+0000 front 2024-09-21T00:48:53.686872+0000 (oldest deadline 2024-09-21T00:49:16.586871+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6[59173]: 2024-09-21T00:49:35.960+0000 7fb974c05640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.988817+0000 front 2024-09-21T00:49:02.988680+0000 (oldest deadline 2024-09-21T00:49:25.888614+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:35.915+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:35.915+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:35.915+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:36.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:35 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:35.915+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:36.423+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:36.423+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:36.423+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:36.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:36.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:36.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:36 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:36.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:36.750 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:36 smithi016 podman[89976]: 2024-09-21 00:49:36.346371987 +0000 UTC m=+5.452902129 container died 493df27ca25f8c222a383f2ff50a9814a84a85cbed70205ec8bb0c93d993e965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T00:49:36.750 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:36 smithi016 podman[89976]: 2024-09-21 00:49:36.750243249 +0000 UTC m=+5.856773390 container cleanup 493df27ca25f8c222a383f2ff50a9814a84a85cbed70205ec8bb0c93d993e965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:36.471+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:36.471+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:36.471+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:36.446+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:36.446+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:36.446+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:36.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:36 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:36.446+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:37.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:36 smithi016 bash[89976]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6 2024-09-21T00:49:37.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:36 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:36.912+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:37.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:36 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:36.912+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:37.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:36 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:36.912+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:37.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:36 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:36.912+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:37.380 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[89992]: 2024-09-21 00:49:37.010057244 +0000 UTC m=+0.657776621 container remove 493df27ca25f8c222a383f2ff50a9814a84a85cbed70205ec8bb0c93d993e965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T00:49:37.440 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:37.150+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:37.441 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:37.150+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:37.441 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:37.150+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:37.664 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.283448884 +0000 UTC m=+0.016507202 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:37.664 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.411239692 +0000 UTC m=+0.144298039 container create 42a89e65550c3f53eb7159af7e006edf8b2c06572cb1efdb9529399a8866bb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T00:49:37.664 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.664215592 +0000 UTC m=+0.397273902 container init 42a89e65550c3f53eb7159af7e006edf8b2c06572cb1efdb9529399a8866bb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T00:49:37.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:37.428+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:37.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:37.428+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:37.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:37.428+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:37.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:37.433+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:37.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:37.433+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:37.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:37.433+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:37.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:37 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:37.433+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:37.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:37.440+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:37.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:37.440+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:37.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:37 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:37.440+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:38.009 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.668216281 +0000 UTC m=+0.401274587 container start 42a89e65550c3f53eb7159af7e006edf8b2c06572cb1efdb9529399a8866bb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.76402517 +0000 UTC m=+0.497083487 container attach 42a89e65550c3f53eb7159af7e006edf8b2c06572cb1efdb9529399a8866bb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 21 00:49:37 smithi016 podman[90083]: 2024-09-21 00:49:37.860440673 +0000 UTC m=+0.593498993 container died 42a89e65550c3f53eb7159af7e006edf8b2c06572cb1efdb9529399a8866bb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:37 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:37.900+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:37 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:37.900+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:37 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:37.900+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:38.010 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:37 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:37.900+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:38.414 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:38.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:38.414 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:38.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:38.414 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:38.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:38.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T00:49:38.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:38.589 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T00:49:38.589 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T00:49:38.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.7 2024-09-21T00:49:38.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.467+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:38.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.467+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:38.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.467+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:38.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 systemd[1]: Stopping Ceph osd.7 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:38.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:38.411+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:38.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:38.411+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:38.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:38.411+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:38.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:38.411+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:38.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:38.413+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:38.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:38.413+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:38.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:38 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:38.413+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:39.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:38 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:38.921+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:39.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:38 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:38.921+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:39.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:38 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:38.921+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:39.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:38 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:38.921+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:39.270 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.897+0000 7fd86c301640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:39.270 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.897+0000 7fd86c301640 -1 osd.7 78 *** Got signal Terminated *** 2024-09-21T00:49:39.270 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:38 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:38.897+0000 7fd86c301640 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:39.532 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:39.479+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:39.532 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:39.479+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:39.533 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:39.479+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:39.533 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:39.435+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:39.533 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:39.435+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:39.533 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:39.435+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:39.533 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:39.435+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:39.536 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:39.398+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:39.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:39.398+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:39.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:39.398+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:39.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:39.166+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:39.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:39.166+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:39.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:39 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:39.166+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:40.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:39 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:39.930+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:40.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:39 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:39.930+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:40.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:39 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:39.930+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:40.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:39 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:39.930+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:40.442 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:40.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:40.442 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:40.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:40.442 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:40.135+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:40.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:40.494+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:40.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:40.494+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:40.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:40.494+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:40.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:40.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:40.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:40.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:40.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:40.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:40.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:40 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:40.399+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:40.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:40.441+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:40.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:40.441+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:40.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:40 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:40.441+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:41.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:40.889+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:41.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:40.889+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:41.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:40.889+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:41.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:40 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:40.889+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:41.426 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:41.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:41.426 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:41.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:41.426 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:41.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:41.509+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:41.509+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:41.509+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:41.405+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:41.405+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:41.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:41.405+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:41.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:41.405+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:41.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:41 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:41.405+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:41.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:41.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:41.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:41.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:41.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:41.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:41.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:41 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:41.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:42.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:41.937+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:42.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:41.937+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:42.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:41.937+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:42.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:41 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:41.937+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:42.423 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:42.164+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:42.423 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:42.164+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:42.423 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:42.164+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:42.423 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:42.164+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:42.532+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:42.532+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:42.532+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:42.430+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:42.430+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:42.430+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:42.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:42.430+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:42.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:42 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:42.430+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:42.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:42.422+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:42.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:42.422+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:42.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:42.422+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:42.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:42 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:42.422+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:43.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:42.928+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:43.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:42.928+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:43.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:42.928+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:43.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:42.928+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:43.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:42 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:42.928+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:43.193+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:43.193+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:43.193+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:43.193+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:43.396+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:43.396+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:43.396+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:43.399 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:43 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:43.396+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:43.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:43.555+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:50.611578+0000 front 2024-09-21T00:48:50.611606+0000 (oldest deadline 2024-09-21T00:49:16.511721+0000) 2024-09-21T00:49:43.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:43.555+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.612965+0000 front 2024-09-21T00:49:00.613075+0000 (oldest deadline 2024-09-21T00:49:24.113054+0000) 2024-09-21T00:49:43.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:43.555+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:09.314846+0000 front 2024-09-21T00:49:09.314930+0000 (oldest deadline 2024-09-21T00:49:34.614920+0000) 2024-09-21T00:49:43.770 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7[51539]: 2024-09-21T00:49:43.555+0000 7fd8688ec640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:17.416504+0000 front 2024-09-21T00:49:17.416392+0000 (oldest deadline 2024-09-21T00:49:43.316571+0000) 2024-09-21T00:49:43.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:43.397+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:43.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:43.397+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:43.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:43.397+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:43.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:43.397+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:43.771 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:43 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:43.397+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:44.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:43.918+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:44.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:43.918+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:44.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:43.918+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:44.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:43.918+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:44.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:43 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:43.918+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:44.350+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:44.350+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:44.350+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:44.350+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:44.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:44.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:44.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:44.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:44 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:44.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:44.723 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:44 smithi123 podman[66206]: 2024-09-21 00:49:44.439149095 +0000 UTC m=+5.659056598 container died ae1684ca2d8f928216565ee04a7aa83b627e445f2b4c5bdc1ba0d95898e0074a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T00:49:44.723 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:44.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:44.723 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:44.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:44.723 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:44.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:44.723 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:44.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:44.724 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:44.352+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:45.020 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:44 smithi123 podman[66206]: 2024-09-21 00:49:44.838681535 +0000 UTC m=+6.058589029 container cleanup ae1684ca2d8f928216565ee04a7aa83b627e445f2b4c5bdc1ba0d95898e0074a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T00:49:45.020 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:44 smithi123 bash[66206]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7 2024-09-21T00:49:45.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:44 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:44.904+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:45.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:44 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:44.904+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:45.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:44 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:44.904+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:45.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:44 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:44.904+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:45.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:44 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:44.904+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:45.447 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66235]: 2024-09-21 00:49:45.098314433 +0000 UTC m=+0.655000285 container remove ae1684ca2d8f928216565ee04a7aa83b627e445f2b4c5bdc1ba0d95898e0074a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T00:49:45.447 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:45 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:45.330+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:45.447 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:45 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:45.330+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:45.447 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:45 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:45.330+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:45.448 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:45 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:45.330+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:45.448 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:45 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:45.330+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:45.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:45.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:45.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:45.158+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:45.326+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:45.326+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:45.326+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:45.537 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:45 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:45.326+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:45.727 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.349658765 +0000 UTC m=+0.016022259 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:45.727 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.473944375 +0000 UTC m=+0.140307853 container create f43e320be4af8944774fa99ac054f1e03d2636e3757447fd70b1c9f2762298da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T00:49:46.020 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.726861114 +0000 UTC m=+0.393224592 container init f43e320be4af8944774fa99ac054f1e03d2636e3757447fd70b1c9f2762298da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T00:49:46.020 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.730487633 +0000 UTC m=+0.396851112 container start f43e320be4af8944774fa99ac054f1e03d2636e3757447fd70b1c9f2762298da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T00:49:46.021 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.838115403 +0000 UTC m=+0.504478884 container attach f43e320be4af8944774fa99ac054f1e03d2636e3757447fd70b1c9f2762298da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T00:49:46.021 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 00:49:45 smithi123 podman[66323]: 2024-09-21 00:49:45.916594491 +0000 UTC m=+0.582957977 container died f43e320be4af8944774fa99ac054f1e03d2636e3757447fd70b1c9f2762298da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:49:46.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:45 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:45.936+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:46.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:45 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:45.936+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:46.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:45 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:45.936+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:46.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:45 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:45.936+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:46.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:45 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:45.936+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:46.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:46.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:46.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:46.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:46.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:46.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:46.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:46.119+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:46.538 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.356+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:46.538 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.356+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:46.538 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.356+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:46.538 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.356+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:46.580 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:46 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:46.321+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:46.580 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:46 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:46.321+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:46.580 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:46 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:46.321+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:46.580 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:46 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:46.321+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:46.580 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:46 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:46.321+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:46.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T00:49:46.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:46.649 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T00:49:46.649 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T00:49:46.650 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.8 2024-09-21T00:49:46.955 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 systemd[1]: Stopping Ceph osd.8 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:46.955 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.954+0000 7f373a7b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:47.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:46 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:46.926+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:47.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:46 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:46.926+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:47.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:46 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:46.926+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:47.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:46 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:46.926+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:47.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:46 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:46.926+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.954+0000 7f373a7b6640 -1 osd.8 78 *** Got signal Terminated *** 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:46 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:46.954+0000 7f373a7b6640 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:47.100+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:47.100+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:47.100+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:47.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:47.100+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:47.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:47.293+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:47.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:47.293+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:47.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:47.293+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:47.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:47.293+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:47.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:47 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:47.293+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:47.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:47.403+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:47.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:47.403+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:47.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:47.403+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:47.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:47 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:47.403+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:48.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:47 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:47.887+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:48.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:47 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:47.887+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:48.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:47 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:47.887+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:48.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:47 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:47.887+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:48.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:47 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:47.887+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:48.077+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:48.077+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:48.077+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:48.077+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:48.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:48.284+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:48.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:48.284+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:48.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:48.284+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:48.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:48.284+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:48.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:48.284+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:48.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:48.446+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:48.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:48.446+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:48.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:48.446+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:48.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:48 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:48.446+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:49.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:48.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:49.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:48.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:49.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:48.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:49.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:48.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:49.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:48 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:48.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:49.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:49.065+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:49.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:49.065+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:49.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:49.065+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:49.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:49.065+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:49.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:49.065+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:49.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:49 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:49.261+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:49.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:49 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:49.261+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:49.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:49 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:49.261+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:49.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:49 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:49.261+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:49.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:49 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:49.261+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:49.786 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:49.450+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:49.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:49.450+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:49.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:49.450+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:49.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:49 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:49.450+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:50.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:49 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:49.839+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:50.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:49 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:49.839+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:50.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:49 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:49.839+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:50.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:49 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:49.839+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:50.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:49 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:49.839+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:50.426 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:50.102+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:50.426 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:50.102+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:50.427 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:50.102+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:50.427 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:50.102+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:50.427 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:50.102+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:50.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:50.282+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:50.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:50.282+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:50.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:50.282+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:50.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:50.282+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:50.770 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:50 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:50.282+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:50.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:50.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:50.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:50.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:50.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:50.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:50.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:50 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:50.425+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:51.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:50 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:50.859+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:51.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:50 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:50.859+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:51.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:50 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:50.859+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:51.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:50 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:50.859+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:51.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:50 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:50.859+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:51.389 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:51.095+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:51.389 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:51.095+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:51.389 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:51.095+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:51.389 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:51.095+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:51.389 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:51.095+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:51.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:51 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:51.243+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:51.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:51 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:51.243+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:51.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:51 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:51.243+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:51.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:51 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:51.243+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:51.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:51 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:51.243+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:51.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:51.388+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.514520+0000 front 2024-09-21T00:48:54.514568+0000 (oldest deadline 2024-09-21T00:49:18.014596+0000) 2024-09-21T00:49:51.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:51.388+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:00.216173+0000 front 2024-09-21T00:49:00.216104+0000 (oldest deadline 2024-09-21T00:49:25.516343+0000) 2024-09-21T00:49:51.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:51.388+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.217503+0000 front 2024-09-21T00:49:10.217648+0000 (oldest deadline 2024-09-21T00:49:36.117363+0000) 2024-09-21T00:49:51.787 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:51 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8[52350]: 2024-09-21T00:49:51.388+0000 7f3736da1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.118128+0000 front 2024-09-21T00:49:16.118000+0000 (oldest deadline 2024-09-21T00:49:40.817878+0000) 2024-09-21T00:49:52.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:51 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:51.902+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:52.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:51 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:51.902+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:52.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:51 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:51.902+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:52.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:51 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:51.902+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:52.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:51 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:51.902+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:52.358 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:52.091+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:52.358 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:52.091+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:52.358 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:52.091+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:52.358 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:52.091+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:52.358 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:52.091+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:52.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:52 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:52.201+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:52.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:52 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:52.201+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:52.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:52 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:52.201+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:52.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:52 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:52.201+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:52.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:52 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:52.201+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:52.646 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:52 smithi178 podman[67275]: 2024-09-21 00:49:52.357580947 +0000 UTC m=+5.508990814 container died c9b1d6786e0b8cef0b95ef1fa0263bababfcfde8dbcede92d9de717298c94f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T00:49:53.005 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:52 smithi178 podman[67275]: 2024-09-21 00:49:52.736905017 +0000 UTC m=+5.888314886 container cleanup c9b1d6786e0b8cef0b95ef1fa0263bababfcfde8dbcede92d9de717298c94f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:49:53.005 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:52 smithi178 bash[67275]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8 2024-09-21T00:49:53.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:52 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:52.901+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:53.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:52 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:52.901+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:53.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:52 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:52.901+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:53.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:52 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:52.901+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:53.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:52 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:52.901+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67292]: 2024-09-21 00:49:53.004828259 +0000 UTC m=+0.640867065 container remove c9b1d6786e0b8cef0b95ef1fa0263bababfcfde8dbcede92d9de717298c94f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:53 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:53.130+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:53 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:53.130+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:53 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:53.130+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:53 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:53.130+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:53.287 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:53 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:53.130+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:53.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:53 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:53.225+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:53.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.216692604 +0000 UTC m=+0.016114437 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:49:53.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.322429759 +0000 UTC m=+0.121851593 container create 6392b6107497f48522ae75b3d10092b488cbe5f14660182cad499bbd9acc8916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T00:49:53.643 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.550412064 +0000 UTC m=+0.349833897 container init 6392b6107497f48522ae75b3d10092b488cbe5f14660182cad499bbd9acc8916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T00:49:53.643 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.553984286 +0000 UTC m=+0.353406129 container start 6392b6107497f48522ae75b3d10092b488cbe5f14660182cad499bbd9acc8916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T00:49:53.643 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.642011452 +0000 UTC m=+0.441433286 container attach 6392b6107497f48522ae75b3d10092b488cbe5f14660182cad499bbd9acc8916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:49:54.036 INFO:journalctl@ceph.osd.8.smithi178.stdout:Sep 21 00:49:53 smithi178 podman[67381]: 2024-09-21 00:49:53.750182295 +0000 UTC m=+0.549604139 container died 6392b6107497f48522ae75b3d10092b488cbe5f14660182cad499bbd9acc8916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T00:49:54.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:54.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:54.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:54.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:54.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:54.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:53 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:53.944+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:54.421 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:54 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:54.154+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:54.421 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:54 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:54.154+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:54.421 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:54 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:54.154+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:54.421 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:54 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:54.154+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:54.421 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:54 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:54.154+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:54.449 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T00:49:54.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:49:54.490 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T00:49:54.490 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T00:49:54.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.9 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:54.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:54 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:54.229+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:54.822 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 systemd[1]: Stopping Ceph osd.9 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:49:55.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.820+0000 7f6cb4984640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:49:55.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.820+0000 7f6cb4984640 -1 osd.9 78 *** Got signal Terminated *** 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.820+0000 7f6cb4984640 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:55.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:54 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:54.895+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:55.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:55 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:55.188+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:55.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:55 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:55.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:55.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:55 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:55.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:55.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:55 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:55.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:55.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:55 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:55.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:55.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:55 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:55.190+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:56.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:56.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:56.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:56.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:56.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:56.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:55 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:55.867+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:56.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:56 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:56.178+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:56.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:56.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:56.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:56.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:56.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:56.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:56.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:56.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:56.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:56.162+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:57.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:57.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:57.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:57.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:57.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:57.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:56 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:56.893+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:57.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:57 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:57.141+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:57.536 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:57.204+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:57.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:57.204+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:57.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:57.204+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:57.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:57.204+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:57.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:57 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:57.204+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:58.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:58.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:58.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:58.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:58.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:58.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:58.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:57 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:57.878+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.028236+0000 front 2024-09-21T00:49:34.028279+0000 (oldest deadline 2024-09-21T00:49:57.528376+0000) 2024-09-21T00:49:58.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:58.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:58.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:58.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:58.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:58.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:58 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:58.106+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:58.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:58.177+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:58.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:58.177+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:58.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:58.177+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:58.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:58.177+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:58.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:58 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:58.177+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:49:59.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:45.521138+0000 front 2024-09-21T00:48:45.521214+0000 (oldest deadline 2024-09-21T00:49:10.821375+0000) 2024-09-21T00:49:59.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:54.922750+0000 front 2024-09-21T00:48:54.922808+0000 (oldest deadline 2024-09-21T00:49:17.822613+0000) 2024-09-21T00:49:59.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:01.323622+0000 front 2024-09-21T00:49:01.323613+0000 (oldest deadline 2024-09-21T00:49:26.623618+0000) 2024-09-21T00:49:59.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:10.025053+0000 front 2024-09-21T00:49:10.025088+0000 (oldest deadline 2024-09-21T00:49:33.525247+0000) 2024-09-21T00:49:59.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:18.826317+0000 front 2024-09-21T00:49:18.826258+0000 (oldest deadline 2024-09-21T00:49:42.326275+0000) 2024-09-21T00:49:59.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.627417+0000 front 2024-09-21T00:49:27.627542+0000 (oldest deadline 2024-09-21T00:49:52.927402+0000) 2024-09-21T00:49:59.260 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:49:58 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9[65681]: 2024-09-21T00:49:58.833+0000 7f6cb0f6f640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.028236+0000 front 2024-09-21T00:49:34.028279+0000 (oldest deadline 2024-09-21T00:49:57.528376+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:49:59.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:49:59 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:49:59.134+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:49:59.536 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:59 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:59.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:49:59.536 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:59 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:59.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:49:59.536 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:59 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:59.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:49:59.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:59 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:59.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:49:59.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:49:59 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:49:59.171+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:00.510 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:00 smithi016 podman[90198]: 2024-09-21 00:50:00.337832213 +0000 UTC m=+5.646366955 container died 3a91766e6c82f76c02359b3ea2ac5cae0e17ba16ae193db15633f98a6a45d282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:00.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:00 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:00.128+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:00.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:00.173+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:00.856 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:00 smithi016 podman[90198]: 2024-09-21 00:50:00.662741122 +0000 UTC m=+5.971275852 container cleanup 3a91766e6c82f76c02359b3ea2ac5cae0e17ba16ae193db15633f98a6a45d282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:00.856 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:00 smithi016 bash[90198]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9 2024-09-21T00:50:01.259 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:00 smithi016 podman[90213]: 2024-09-21 00:50:00.855722142 +0000 UTC m=+0.513727224 container remove 3a91766e6c82f76c02359b3ea2ac5cae0e17ba16ae193db15633f98a6a45d282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:01.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:01.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:01 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:01.094+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:01.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:01 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:01.192+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:01.693 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.299229438 +0000 UTC m=+0.109746018 container create b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:50:01.693 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.206249767 +0000 UTC m=+0.016766309 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:50:01.693 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.500603707 +0000 UTC m=+0.311120260 container init b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T00:50:01.693 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.504189212 +0000 UTC m=+0.314705756 container start b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T00:50:01.693 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.69206709 +0000 UTC m=+0.502583648 container attach b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T00:50:01.978 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:01 smithi016 podman[90303]: 2024-09-21 00:50:01.69516546 +0000 UTC m=+0.505682005 container died b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T00:50:02.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T00:50:02.251 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:02 smithi016 podman[90327]: 2024-09-21 00:50:02.195667042 +0000 UTC m=+0.490659115 container remove b89516ebb8eeca1b90663a90d58debbc4836b890a4f96c2674f461779098b640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:50:02.251 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:02 smithi016 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.9.service: Deactivated successfully. 2024-09-21T00:50:02.251 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:02 smithi016 systemd[1]: Stopped Ceph osd.9 for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:50:02.251 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 21 00:50:02 smithi016 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.9.service: Consumed 5.886s CPU time. 2024-09-21T00:50:02.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:02.267 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T00:50:02.267 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T00:50:02.267 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.10 2024-09-21T00:50:02.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.063+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:02.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 systemd[1]: Stopping Ceph osd.10 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:02.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:02 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:02.197+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:03.020 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.564+0000 7f87f9a6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:03.020 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.564+0000 7f87f9a6a640 -1 osd.10 78 *** Got signal Terminated *** 2024-09-21T00:50:03.020 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:02 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:02.564+0000 7f87f9a6a640 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:03.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:03.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:03 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:03.085+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:03.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:03.538 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:03.538 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:03.538 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:03.538 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:03.538 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:03 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:03.247+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:04.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:04 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:04.104+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:04.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:04.284+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:05.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:05 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:05.117+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:05.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:05 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:05.308+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:06.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.165+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:06.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:06.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:06.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:06.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:06.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:06.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:06 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:06.166+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:06.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:06 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:06.279+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:07.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:46.643003+0000 front 2024-09-21T00:48:46.642863+0000 (oldest deadline 2024-09-21T00:49:11.342960+0000) 2024-09-21T00:50:07.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:51.343273+0000 front 2024-09-21T00:48:51.343352+0000 (oldest deadline 2024-09-21T00:49:16.043519+0000) 2024-09-21T00:50:07.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.945577+0000 front 2024-09-21T00:49:02.945694+0000 (oldest deadline 2024-09-21T00:49:25.245371+0000) 2024-09-21T00:50:07.520 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-21T00:49:11.047024+0000 front 2024-09-21T00:49:11.046908+0000 (oldest deadline 2024-09-21T00:49:34.546859+0000) 2024-09-21T00:50:07.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:16.247686+0000 front 2024-09-21T00:49:16.247720+0000 (oldest deadline 2024-09-21T00:49:40.947853+0000) 2024-09-21T00:50:07.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:27.849773+0000 front 2024-09-21T00:49:27.849679+0000 (oldest deadline 2024-09-21T00:49:52.450183+0000) 2024-09-21T00:50:07.521 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10[58210]: 2024-09-21T00:50:07.119+0000 7f87f6055640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:32.450787+0000 front 2024-09-21T00:49:32.450730+0000 (oldest deadline 2024-09-21T00:49:58.350628+0000) 2024-09-21T00:50:07.536 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:07.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:07 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:07.265+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:08.270 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:07 smithi123 podman[66427]: 2024-09-21 00:50:07.991852287 +0000 UTC m=+5.523159328 container died ec8f4620212ee58935e755093299c8357130eba46160d30d32fd0c60797aa169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T00:50:08.633 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:08 smithi123 podman[66427]: 2024-09-21 00:50:08.373916717 +0000 UTC m=+5.905223757 container cleanup ec8f4620212ee58935e755093299c8357130eba46160d30d32fd0c60797aa169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:08.633 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:08 smithi123 bash[66427]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:08.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:08 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:08.312+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:08.944 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:08 smithi123 podman[66442]: 2024-09-21 00:50:08.633333063 +0000 UTC m=+0.636924559 container remove ec8f4620212ee58935e755093299c8357130eba46160d30d32fd0c60797aa169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T00:50:09.270 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:08 smithi123 podman[66533]: 2024-09-21 00:50:08.847048435 +0000 UTC m=+0.015852597 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:50:09.270 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:08 smithi123 podman[66533]: 2024-09-21 00:50:08.950612573 +0000 UTC m=+0.119416786 container create e9678abb506b86a05040b81058fe4c376e3a60d17a664bac765c9c0c4fdcd19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:09.270 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:09 smithi123 podman[66533]: 2024-09-21 00:50:09.186602191 +0000 UTC m=+0.355406347 container init e9678abb506b86a05040b81058fe4c376e3a60d17a664bac765c9c0c4fdcd19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T00:50:09.270 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:09 smithi123 podman[66533]: 2024-09-21 00:50:09.19039913 +0000 UTC m=+0.359203282 container start e9678abb506b86a05040b81058fe4c376e3a60d17a664bac765c9c0c4fdcd19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T00:50:09.663 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:09 smithi123 podman[66533]: 2024-09-21 00:50:09.277610244 +0000 UTC m=+0.446414405 container attach e9678abb506b86a05040b81058fe4c376e3a60d17a664bac765c9c0c4fdcd19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T00:50:09.663 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 00:50:09 smithi123 podman[66533]: 2024-09-21 00:50:09.377321657 +0000 UTC m=+0.546125809 container died e9678abb506b86a05040b81058fe4c376e3a60d17a664bac765c9c0c4fdcd19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:09.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:09 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:09.345+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:10.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T00:50:10.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:10.043 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T00:50:10.044 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T00:50:10.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.11 2024-09-21T00:50:10.356 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 systemd[1]: Stopping Ceph osd.11 for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:10.357 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.302+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:10.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.356+0000 7f11457d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:10.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.356+0000 7f11457d7640 -1 osd.11 78 *** Got signal Terminated *** 2024-09-21T00:50:10.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:10 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:10.356+0000 7f11457d7640 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:11.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:11 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:11.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:12.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:12 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:12.269+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:13.787 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:13 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:13.318+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:14.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:14 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:14.278+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-21T00:48:43.489824+0000 front 2024-09-21T00:48:43.490072+0000 (oldest deadline 2024-09-21T00:49:08.790043+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T00:48:53.391684+0000 front 2024-09-21T00:48:53.391562+0000 (oldest deadline 2024-09-21T00:49:16.891621+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-09-21T00:49:02.792510+0000 front 2024-09-21T00:49:02.792654+0000 (oldest deadline 2024-09-21T00:49:26.292673+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T00:49:19.695081+0000 front 2024-09-21T00:49:19.695029+0000 (oldest deadline 2024-09-21T00:49:41.995163+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-09-21T00:49:26.696133+0000 front 2024-09-21T00:49:26.696074+0000 (oldest deadline 2024-09-21T00:49:48.996183+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-21T00:49:34.197657+0000 front 2024-09-21T00:49:34.197706+0000 (oldest deadline 2024-09-21T00:50:00.097395+0000) 2024-09-21T00:50:15.537 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11[58844]: 2024-09-21T00:50:15.229+0000 7f1141dc2640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T00:49:40.097878+0000 front 2024-09-21T00:49:40.097833+0000 (oldest deadline 2024-09-21T00:50:04.797777+0000) 2024-09-21T00:50:16.065 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:15 smithi178 podman[67497]: 2024-09-21 00:50:15.797275059 +0000 UTC m=+5.555831376 container died 78181cea4a485f091222ee60dd93dde7a542c5e5d3c5d15ae396ebe67c60d775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T00:50:16.408 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67497]: 2024-09-21 00:50:16.164363915 +0000 UTC m=+5.922920228 container cleanup 78181cea4a485f091222ee60dd93dde7a542c5e5d3c5d15ae396ebe67c60d775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:16.408 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 bash[67497]: ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11 2024-09-21T00:50:16.724 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67513]: 2024-09-21 00:50:16.407282084 +0000 UTC m=+0.603141114 container remove 78181cea4a485f091222ee60dd93dde7a542c5e5d3c5d15ae396ebe67c60d775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T00:50:17.037 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67606]: 2024-09-21 00:50:16.724709379 +0000 UTC m=+0.109277695 container create 479939f28d7253f202a634ad02adee32a7a7486afad362ee98702fdffbcb21cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T00:50:17.037 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67606]: 2024-09-21 00:50:16.631711162 +0000 UTC m=+0.016279485 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:50:17.037 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67606]: 2024-09-21 00:50:16.943994619 +0000 UTC m=+0.328562930 container init 479939f28d7253f202a634ad02adee32a7a7486afad362ee98702fdffbcb21cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:17.037 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:16 smithi178 podman[67606]: 2024-09-21 00:50:16.947254618 +0000 UTC m=+0.331822932 container start 479939f28d7253f202a634ad02adee32a7a7486afad362ee98702fdffbcb21cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:17.422 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:17 smithi178 podman[67606]: 2024-09-21 00:50:17.043403188 +0000 UTC m=+0.427971499 container attach 479939f28d7253f202a634ad02adee32a7a7486afad362ee98702fdffbcb21cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T00:50:17.422 INFO:journalctl@ceph.osd.11.smithi178.stdout:Sep 21 00:50:17 smithi178 podman[67606]: 2024-09-21 00:50:17.130145691 +0000 UTC m=+0.514714014 container died 479939f28d7253f202a634ad02adee32a7a7486afad362ee98702fdffbcb21cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:17.722 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T00:50:17.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:17.760 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T00:50:17.760 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T00:50:17.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.a 2024-09-21T00:50:18.057 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:17 smithi016 systemd[1]: Stopping Ceph mds.a for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:18.509 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: 2024-09-21T00:50:18.055+0000 7f178159a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:18.509 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:18 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a[72413]: 2024-09-21T00:50:18.055+0000 7f178159a640 -1 mds.a *** got signal Terminated *** 2024-09-21T00:50:22.365 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:22 smithi016 podman[90407]: 2024-09-21 00:50:22.065681619 +0000 UTC m=+4.105809887 container died edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:50:22.681 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:22 smithi016 podman[90407]: 2024-09-21 00:50:22.513541418 +0000 UTC m=+4.553669680 container cleanup edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:22.682 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:22 smithi016 bash[90407]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a 2024-09-21T00:50:22.933 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 21 00:50:22 smithi016 podman[90431]: 2024-09-21 00:50:22.681542866 +0000 UTC m=+0.605069650 container remove edfe208f3b2c751988b265654eccb1ce258c5073bec3131d7ecda556a558af48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T00:50:22.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T00:50:22.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:22.991 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T00:50:22.991 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T00:50:22.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.d 2024-09-21T00:50:23.259 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:23 smithi016 systemd[1]: Stopping Ceph mds.d for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:23.759 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-d[71288]: 2024-09-21T00:50:23.342+0000 7f5adb2a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:23.759 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:23 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-d[71288]: 2024-09-21T00:50:23.342+0000 7f5adb2a8640 -1 mds.d *** got signal Terminated *** 2024-09-21T00:50:25.226 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:24 smithi016 podman[90542]: 2024-09-21 00:50:24.862798007 +0000 UTC m=+1.637345942 container died caacc9d84794c0745ade35f63fde65b39a75c63f6c51f709005949653e5593f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-d, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:50:25.226 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:25 smithi016 podman[90542]: 2024-09-21 00:50:25.226406887 +0000 UTC m=+2.000954811 container cleanup caacc9d84794c0745ade35f63fde65b39a75c63f6c51f709005949653e5593f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:25.486 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 21 00:50:25 smithi016 bash[90542]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-d 2024-09-21T00:50:25.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T00:50:25.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:25.696 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T00:50:25.696 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T00:50:25.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.g 2024-09-21T00:50:26.009 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:25 smithi016 systemd[1]: Stopping Ceph mds.g for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:26.509 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: 2024-09-21T00:50:26.021+0000 7fc6b3a8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:26.509 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:26 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g[72031]: 2024-09-21T00:50:26.021+0000 7fc6b3a8d640 -1 mds.g *** got signal Terminated *** 2024-09-21T00:50:30.306 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:30 smithi016 podman[90665]: 2024-09-21 00:50:30.038302817 +0000 UTC m=+4.121794207 container died 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T00:50:30.857 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:30 smithi016 podman[90665]: 2024-09-21 00:50:30.588924735 +0000 UTC m=+4.672416123 container cleanup 9daa603071110194463f5c1e4bb42eddbbf27d52b5a675745fa0029937d6c1b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T00:50:30.857 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 21 00:50:30 smithi016 bash[90665]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-g 2024-09-21T00:50:31.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T00:50:31.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:31.046 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T00:50:31.046 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T00:50:31.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.j 2024-09-21T00:50:31.361 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:31 smithi016 systemd[1]: Stopping Ceph mds.j for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:31.759 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j[70906]: 2024-09-21T00:50:31.359+0000 7faa2b922640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:31.759 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:31 smithi016 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j[70906]: 2024-09-21T00:50:31.359+0000 7faa2b922640 -1 mds.j *** got signal Terminated *** 2024-09-21T00:50:33.886 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:33 smithi016 podman[90783]: 2024-09-21 00:50:33.520125936 +0000 UTC m=+2.253112630 container died fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:34.136 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:33 smithi016 podman[90783]: 2024-09-21 00:50:33.884794327 +0000 UTC m=+2.617781021 container cleanup fdfd6ea6d9531a2164f846b6e40fe8b53a1bdc0983c94316d57bf1e19e460d34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:50:34.136 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 21 00:50:33 smithi016 bash[90783]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-j 2024-09-21T00:50:34.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T00:50:34.342 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:34.342 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T00:50:34.342 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T00:50:34.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.b 2024-09-21T00:50:34.641 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:34 smithi123 systemd[1]: Stopping Ceph mds.b for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:35.020 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:50:34.639+0000 7fec79cba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:35.020 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:34 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b[63233]: 2024-09-21T00:50:34.639+0000 7fec79cba640 -1 mds.b *** got signal Terminated *** 2024-09-21T00:50:38.931 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:38 smithi123 podman[66649]: 2024-09-21 00:50:38.654724439 +0000 UTC m=+4.122148916 container died 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T00:50:39.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:39 smithi123 podman[66649]: 2024-09-21 00:50:39.030692157 +0000 UTC m=+4.498116643 container cleanup 8c4352023fd758f4bdea51c0f60bf24d084d5bf88265d0c693527a93bbdd9cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T00:50:39.270 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 00:50:39 smithi123 bash[66649]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-b 2024-09-21T00:50:39.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T00:50:39.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:39.449 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T00:50:39.450 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T00:50:39.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.e 2024-09-21T00:50:40.020 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:39 smithi123 systemd[1]: Stopping Ceph mds.e for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:40.020 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: 2024-09-21T00:50:39.775+0000 7f9640ad7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:40.020 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:39 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e[62679]: 2024-09-21T00:50:39.775+0000 7f9640ad7640 -1 mds.e *** got signal Terminated *** 2024-09-21T00:50:43.243 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:42 smithi123 podman[66770]: 2024-09-21 00:50:42.960499449 +0000 UTC m=+3.293062699 container died 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T00:50:43.520 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:43 smithi123 podman[66770]: 2024-09-21 00:50:43.342375378 +0000 UTC m=+3.674938628 container cleanup 0c9eb74bfb932bfbb0a4b7ec97f1fe83f0d92495c41f26e676971c8f23b19d5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T00:50:43.520 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 00:50:43 smithi123 bash[66770]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-e 2024-09-21T00:50:43.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T00:50:43.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:43.809 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T00:50:43.809 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T00:50:43.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.h 2024-09-21T00:50:44.124 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:43 smithi123 systemd[1]: Stopping Ceph mds.h for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:44.124 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: 2024-09-21T00:50:44.120+0000 7f6fef4c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:44.124 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:44 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h[62949]: 2024-09-21T00:50:44.120+0000 7f6fef4c7640 -1 mds.h *** got signal Terminated *** 2024-09-21T00:50:47.264 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:46 smithi123 podman[66906]: 2024-09-21 00:50:46.969233261 +0000 UTC m=+2.944902664 container died a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T00:50:47.520 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:47 smithi123 podman[66906]: 2024-09-21 00:50:47.345860985 +0000 UTC m=+3.321530387 container cleanup a02cfbcc7e3159608b96564566eaed50a728bef370d31ea77226174557e1f217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T00:50:47.520 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 00:50:47 smithi123 bash[66906]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-h 2024-09-21T00:50:47.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T00:50:47.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:47.804 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T00:50:47.804 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T00:50:47.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.k 2024-09-21T00:50:48.133 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:47 smithi123 systemd[1]: Stopping Ceph mds.k for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:48.520 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k[62410]: 2024-09-21T00:50:48.133+0000 7fcc8b1a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:48.520 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:48 smithi123 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k[62410]: 2024-09-21T00:50:48.133+0000 7fcc8b1a6640 -1 mds.k *** got signal Terminated *** 2024-09-21T00:50:51.247 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:50 smithi123 podman[67026]: 2024-09-21 00:50:50.950519326 +0000 UTC m=+2.920779009 container died 7e3b6e071f01249dc6194cc8d625f4cd8d0c540d84d08dc5ff1aecb08a0645e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:50:51.503 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:51 smithi123 podman[67026]: 2024-09-21 00:50:51.490827368 +0000 UTC m=+3.461087052 container cleanup 7e3b6e071f01249dc6194cc8d625f4cd8d0c540d84d08dc5ff1aecb08a0645e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T00:50:51.504 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 00:50:51 smithi123 bash[67026]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-k 2024-09-21T00:50:51.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T00:50:51.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:51.943 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T00:50:51.943 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T00:50:51.943 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.c 2024-09-21T00:50:52.273 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:51 smithi178 systemd[1]: Stopping Ceph mds.c for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:52.537 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c[63955]: 2024-09-21T00:50:52.379+0000 7fd082297640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:52.537 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:52 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c[63955]: 2024-09-21T00:50:52.379+0000 7fd082297640 -1 mds.c *** got signal Terminated *** 2024-09-21T00:50:55.287 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:54 smithi178 podman[67708]: 2024-09-21 00:50:54.949580997 +0000 UTC m=+2.811737599 container died 725fba4cd107ae6098a8b3beb01f621eba3177075e881a2cd08fcbd6d891c124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:50:55.786 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:55 smithi178 podman[67708]: 2024-09-21 00:50:55.554089267 +0000 UTC m=+3.416245872 container cleanup 725fba4cd107ae6098a8b3beb01f621eba3177075e881a2cd08fcbd6d891c124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T00:50:55.787 INFO:journalctl@ceph.mds.c.smithi178.stdout:Sep 21 00:50:55 smithi178 bash[67708]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-c 2024-09-21T00:50:55.932 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T00:50:55.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:55.968 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T00:50:55.968 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T00:50:55.969 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.f 2024-09-21T00:50:56.536 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:56 smithi178 systemd[1]: Stopping Ceph mds.f for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:50:56.537 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: 2024-09-21T00:50:56.291+0000 7f7bda0f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:50:56.537 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:56 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f[63687]: 2024-09-21T00:50:56.291+0000 7f7bda0f1640 -1 mds.f *** got signal Terminated *** 2024-09-21T00:50:59.217 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:58 smithi178 podman[67841]: 2024-09-21 00:50:58.944098309 +0000 UTC m=+2.750450185 container died 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:59.536 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:59 smithi178 podman[67841]: 2024-09-21 00:50:59.316733697 +0000 UTC m=+3.123085563 container cleanup 2c6b2f1f2bf20aa4f1ce5dea3044b06e34c2a6c6067bd33cf2023cf03d85c06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T00:50:59.536 INFO:journalctl@ceph.mds.f.smithi178.stdout:Sep 21 00:50:59 smithi178 bash[67841]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-f 2024-09-21T00:50:59.760 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T00:50:59.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:50:59.794 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T00:50:59.794 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T00:50:59.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.i 2024-09-21T00:51:00.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:50:59 smithi178 systemd[1]: Stopping Ceph mds.i for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:51:00.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:51:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: 2024-09-21T00:51:00.120+0000 7f391eafc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:51:00.287 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:51:00 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i[64225]: 2024-09-21T00:51:00.120+0000 7f391eafc640 -1 mds.i *** got signal Terminated *** 2024-09-21T00:51:03.247 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:51:02 smithi178 podman[67962]: 2024-09-21 00:51:02.957259234 +0000 UTC m=+2.940372528 container died 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T00:51:03.537 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:51:03 smithi178 podman[67962]: 2024-09-21 00:51:03.329102809 +0000 UTC m=+3.312216102 container cleanup 752aeae15ffe50560e857e20a40b5c727962877a7195cbef19901bcf61f8ae39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T00:51:03.537 INFO:journalctl@ceph.mds.i.smithi178.stdout:Sep 21 00:51:03 smithi178 bash[67962]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-i 2024-09-21T00:51:03.717 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T00:51:03.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:51:03.752 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T00:51:03.752 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T00:51:03.752 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.l 2024-09-21T00:51:04.286 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:03 smithi178 systemd[1]: Stopping Ceph mds.l for 49060640-77b1-11ef-baf5-efdc52797490... 2024-09-21T00:51:04.287 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: 2024-09-21T00:51:04.065+0000 7f5c5e619640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:51:04.287 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:04 smithi178 ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l[63418]: 2024-09-21T00:51:04.065+0000 7f5c5e619640 -1 mds.l *** got signal Terminated *** 2024-09-21T00:51:07.216 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:06 smithi178 podman[68081]: 2024-09-21 00:51:06.94129468 +0000 UTC m=+2.971496650 container stop 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T00:51:07.216 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:06 smithi178 podman[68081]: 2024-09-21 00:51:06.966950822 +0000 UTC m=+2.997152790 container died 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T00:51:07.475 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 podman[68081]: 2024-09-21 00:51:07.299297443 +0000 UTC m=+3.329499410 container cleanup 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:51:07.476 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 bash[68081]: ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l 2024-09-21T00:51:07.717 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T00:51:07.738 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 podman[68093]: 2024-09-21 00:51:07.47535122 +0000 UTC m=+0.527042420 container remove 34a02085604ce43c9b9b6a25f14443de25bb3dc2c913c029bcb07e63ba6462bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-49060640-77b1-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T00:51:07.738 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.l.service: Deactivated successfully. 2024-09-21T00:51:07.738 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 systemd[1]: Stopped Ceph mds.l for 49060640-77b1-11ef-baf5-efdc52797490. 2024-09-21T00:51:07.738 INFO:journalctl@ceph.mds.l.smithi178.stdout:Sep 21 00:51:07 smithi178 systemd[1]: ceph-49060640-77b1-11ef-baf5-efdc52797490@mds.l.service: Consumed 1.358s CPU time. 2024-09-21T00:51:07.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T00:51:07.748 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T00:51:07.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T00:51:07.964 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:10.564 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T00:51:10.766 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:13.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T00:51:13.393 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:15.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:51:15.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:51:15.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:51:15.891 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T00:51:15.894 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi016/crash 2024-09-21T00:51:15.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T00:51:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T00:51:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2024-09-21T00:51:15.935 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi123/crash 2024-09-21T00:51:15.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T00:51:15.975 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T00:51:15.975 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-09-21T00:51:15.977 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi178/crash 2024-09-21T00:51:15.977 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T00:51:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/49060640-77b1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T00:51:16.020 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2024-09-21T00:51:16.021 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T00:51:16.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T00:51:16.061 INFO:tasks.cephadm:Compressing logs... 2024-09-21T00:51:16.062 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T00:51:16.104 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T00:51:16.107 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T00:51:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T00:51:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:: No such file or directory 2024-09-21T00:51:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T00:51:16.131 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T00:51:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T00:51:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T00:51:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T00:51:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T00:51:16.136 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T00:51:16.137 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T00:51:16.137 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T00:51:16.137 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T00:51:16.137 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T00:51:16.137 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:: No such file or directory 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr: 82.4% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T00:51:16.142 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.2.log: --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr: 90.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log: 86.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T00:51:16.143 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T00:51:16.145 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log: 86.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T00:51:16.145 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T00:51:16.145 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.d.log: 95.0% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T00:51:16.145 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:: No such file or directory 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T00:51:16.146 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T00:51:16.147 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T00:51:16.147 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T00:51:16.147 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T00:51:16.147 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T00:51:16.147 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T00:51:16.148 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.8.log: 90.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T00:51:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T00:51:16.150 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.y.log: 91.6% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T00:51:16.150 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T00:51:16.150 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log: 90.9% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T00:51:16.150 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T00:51:16.150 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.h.log: 86.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T00:51:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T00:51:16.152 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T00:51:16.154 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T00:51:16.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.1% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T00:51:16.155 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T00:51:16.159 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.z.log: 91.7% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T00:51:16.166 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T00:51:16.167 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T00:51:16.173 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T00:51:16.176 INFO:teuthology.orchestra.run.smithi016.stderr: 93.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T00:51:16.177 INFO:teuthology.orchestra.run.smithi016.stderr: 93.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T00:51:16.179 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.c.log: 93.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T00:51:16.179 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T00:51:16.180 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.e.log: 93.9% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T00:51:16.182 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.f.log: 92.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T00:51:16.182 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T00:51:16.184 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T00:51:16.202 INFO:teuthology.orchestra.run.smithi123.stderr: 92.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T00:51:16.217 INFO:teuthology.orchestra.run.smithi178.stderr: 92.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T00:51:16.220 INFO:teuthology.orchestra.run.smithi123.stderr: 92.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T00:51:16.355 INFO:teuthology.orchestra.run.smithi016.stderr: 89.9% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T00:51:16.359 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T00:51:16.412 INFO:teuthology.orchestra.run.smithi178.stderr: 91.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T00:51:16.615 INFO:teuthology.orchestra.run.smithi178.stderr: 95.7% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T00:51:16.663 INFO:teuthology.orchestra.run.smithi016.stderr: 90.5% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T00:51:16.827 INFO:teuthology.orchestra.run.smithi178.stderr: 92.2% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T00:51:16.866 INFO:teuthology.orchestra.run.smithi016.stderr: 91.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T00:51:17.227 INFO:teuthology.orchestra.run.smithi178.stderr: 91.1% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T00:51:17.297 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T00:51:17.318 INFO:teuthology.orchestra.run.smithi123.stderr: 91.9% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T00:51:17.451 INFO:teuthology.orchestra.run.smithi016.stderr: 92.6% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T00:51:17.510 INFO:teuthology.orchestra.run.smithi016.stderr: 92.7% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T00:51:17.560 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T00:51:17.562 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-21T00:51:17.562 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m1.443s 2024-09-21T00:51:17.562 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m5.519s 2024-09-21T00:51:17.562 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.199s 2024-09-21T00:51:17.633 INFO:teuthology.orchestra.run.smithi123.stderr: 93.0% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T00:51:17.835 INFO:teuthology.orchestra.run.smithi178.stderr: 92.8% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T00:51:17.982 INFO:teuthology.orchestra.run.smithi123.stderr: 92.6% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T00:51:19.708 INFO:teuthology.orchestra.run.smithi178.stderr: 95.6% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T00:51:19.710 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-21T00:51:19.710 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m3.589s 2024-09-21T00:51:19.710 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m7.653s 2024-09-21T00:51:19.710 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m0.304s 2024-09-21T00:51:19.760 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/49060640-77b1-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T00:51:19.761 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-21T00:51:19.761 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m3.639s 2024-09-21T00:51:19.761 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m9.399s 2024-09-21T00:51:19.761 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.302s 2024-09-21T00:51:19.762 INFO:tasks.cephadm:Archiving logs... 2024-09-21T00:51:19.763 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi016/log 2024-09-21T00:51:19.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T00:51:20.544 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi123/log 2024-09-21T00:51:20.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T00:51:21.849 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi178/log 2024-09-21T00:51:21.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T00:51:22.863 INFO:tasks.cephadm:Removing cluster... 2024-09-21T00:51:22.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force 2024-09-21T00:51:23.077 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:23.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force 2024-09-21T00:51:23.546 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:23.813 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 49060640-77b1-11ef-baf5-efdc52797490 --force 2024-09-21T00:51:24.005 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 49060640-77b1-11ef-baf5-efdc52797490 2024-09-21T00:51:24.272 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T00:51:24.275 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T00:51:24.302 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T00:51:24.319 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T00:51:24.336 INFO:tasks.cephadm:Teardown complete 2024-09-21T00:51:24.336 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T00:51:24.834 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T00:51:24.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T00:51:24.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T00:51:24.842 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T00:51:24.942 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T00:51:24.953 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T00:51:24.953 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:51:24.956 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:51:24.959 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:51:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:51:24.973 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:51:24.973 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:51:24.977 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:51:24.977 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-21T00:51:24.977 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +487us[ +473us] +/- 54ms 2024-09-21T00:51:24.977 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -1179us[-1193us] +/- 55ms 2024-09-21T00:51:24.978 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +831us[ +817us] +/- 64ms 2024-09-21T00:51:24.978 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:51:24.979 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:51:24.979 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-21T00:51:24.979 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +492us[ +567us] +/- 53ms 2024-09-21T00:51:24.979 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -1189us[-1189us] +/- 55ms 2024-09-21T00:51:24.980 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +825us[ +825us] +/- 64ms 2024-09-21T00:51:24.980 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:51:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:51:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-21T00:51:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +525us[ +530us] +/- 54ms 2024-09-21T00:51:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 5 -1114us[-1109us] +/- 55ms 2024-09-21T00:51:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 1 +887us[ +887us] +/- 64ms 2024-09-21T00:51:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:51:24.981 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T00:51:24.996 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T00:51:24.996 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T00:51:25.020 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T00:51:25.104 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T00:51:25.174 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T00:51:25.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:51:25.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:25.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:51:25.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:25.302 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:51:25.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:25.330 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T00:51:25.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T00:51:25.393 INFO:teuthology.task.internal:Duration was 1347.188692 seconds 2024-09-21T00:51:25.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T00:51:25.420 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T00:51:25.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T00:51:25.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T00:51:25.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T00:51:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:51:25.464 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:51:25.464 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:51:25.821 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T00:51:25.821 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-09-21T00:51:25.822 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T00:51:25.846 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-21T00:51:25.846 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T00:51:25.876 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-21T00:51:25.877 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T00:51:25.904 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T00:51:25.904 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T00:51:25.907 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T00:51:25.920 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T00:51:25.970 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T00:51:25.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T00:51:25.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T00:51:25.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T00:51:26.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T00:51:26.596 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T00:51:26.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T00:51:26.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T00:51:26.648 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T00:51:26.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T00:51:26.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.710 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-09-21T00:51:26.711 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-21T00:51:26.737 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-21T00:51:26.772 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:26.787 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:26.802 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T00:51:26.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:51:26.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T00:51:26.838 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T00:51:26.839 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi016 2024-09-21T00:51:26.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T00:51:26.886 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi123 2024-09-21T00:51:26.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T00:51:26.923 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913336/remote/smithi178 2024-09-21T00:51:26.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T00:51:26.959 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T00:51:26.960 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T00:51:26.962 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T00:51:26.966 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T00:51:27.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T00:51:27.023 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T00:51:27.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T00:51:27.034 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T00:51:27.034 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T00:51:27.036 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T00:51:27.039 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T00:51:27.049 INFO:teuthology.orchestra.run.smithi016.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 00:51 /home/ubuntu/cephtest 2024-09-21T00:51:27.051 INFO:teuthology.orchestra.run.smithi123.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 00:51 /home/ubuntu/cephtest 2024-09-21T00:51:27.065 INFO:teuthology.orchestra.run.smithi178.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 00:51 /home/ubuntu/cephtest 2024-09-21T00:51:27.066 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T00:51:27.079 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T00:51:27.105 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} duration: 1347.1886916160583 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T00:51:27.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:51:27.192 INFO:teuthology.run:pass